Intelligent performance-based product recommendation system

ABSTRACT

Systems and methods of utilizing communications networks and multivariate analysis to predict or recommend optimal products from a predefined population of commercially available products are disclosed. The recommendations are based on intelligence contained in processing elements and subjective and/or objective product information received from consumers or input to the systems as part of their initial setup. The output of the systems comprise sets of products that they predict the consumer will prefer and/or perform well for the problem or concern identified by the consumer. The performance and preference predictions are a function of consumer problems and product responsiveness patterns. Objective product information is generally obtained with diagnostic instruments. Data measured with the diagnostic instruments may be communicated to the data processing portions of the invention via the Internet. The outputs of the data processing portion of the system may be presented to consumers via the Internet as well.

I. CROSS REFERENCE TO RELATED APPLICATIONS

This application is a divisional of U.S. patent application Ser. No.12/820,844 filed Jun. 22, 2010, which is a divisional of U.S. patentapplication Ser. No. 09/981,516, filed Oct. 17, 2001. U.S. patentapplication Ser. No. 09/981,516 claims the benefit of U.S. PatentApplication Ser. No. 60/241,405, filed Oct. 18, 2000. U.S. patentapplication Ser. Nos. 12/820,844, 09/981,516 and 60/241,405 areincorporated herein by reference in their entireties.

II. BACKGROUND

A. Field of the Invention

The present invention relates generally to systems and methods forgenerating, communicating and processing product information. Moreparticularly, the invention is directed to gathering subjective andobjective data on the effects of products from consumers and using thatdata to generate product recommendations and ancillary information, toperiodically improve the accuracy of the recommendations, and tocommunicate the product recommendations and ancillary information to theconsumers.

B. Description of the Related Art

Many commercially available products provide useful results only afterprolonged use. For some products, their effects may be incrementalduring the period of use. The changes wrought by the use of manyproducts therefore may not be fully appreciated by consumers. This lackof appreciation results from, among other things, the inability of theconsumer to meaningfully compare conditions pre- and post-product use.Rather, as conditions change, however incrementally, there is a tendencyto compare results to a condition after product use has begun. As aconsequence, the consumer may get a false impression of the product'sefficacy be it positive, negative, or neutral.

Further compounding the inability of consumers to meaningfully assessthe efficacy of many commercially available products is the difficultyof testing the many options in the market and the failure or inabilityof many products to carry labels communicating their objectiveperformance with respect to the conditions of interest to consumers. Theadvent of the Internet and developments in the areas of recommendationsystems, neural networks, and collaborative filtering, however, nowprovide opportunities to address the foregoing problems.

The Internet and Other Public and Private Networks

The term “Internet” is an abbreviation for “Internetwork” and commonlyrefers to the collection of networks and gateways that utilize theTCP/IP suite of protocols, which are well-known in the art of computernetworking. TCP/IP is an acronym for “Transmission ControlProtocol/Internet Protocol.” The Internet can be described as a systemof geographically distributed remote computer networks interconnected bycomputers executing networking protocols that allow users to interactand share information over the networks. Because of such wide-spreadinformation sharing, remote networks such as the Internet have thus fargenerally evolved into an “open” system for which developers can designsoftware applications for performing specialized operations or services,essentially without restriction.

Electronic information transferred between data-processing networks isusually presented in hypertext, a metaphor for presenting information ina manner in which text, images, sounds, and actions become linkedtogether in a complex non-sequential web of associations that permit theuser to “browse” or “navigate” through related topics, regardless of thepresented order of the topics. These links are often established by boththe author of a hypertext document and by the user, depending on theintent of the hypertext document. For example, traveling among links tothe word “iron” in an article displayed within a graphical userinterface in a data-processing system might lead the user to theperiodic table of the chemical elements (i.e., linked by the word“iron”), or to a reference to the use of iron in weapons in Europe inthe Dark Ages. The term “hypertext” was coined in the 1960s to describedocuments, as presented by a computer, that express the nonlinearstructure of ideas, as opposed to the linear format of books, film, andspeech.

A typical networked system that utilizes hypertext conventions follows aclient/server architecture. The “client” is a member of a class or groupthat uses the services of another class or group to which it is notrelated. Thus, in computing, a client is a process (i.e., roughly a setof instructions or tasks) that requests a service provided by anotherprogram. The client process utilizes the requested service withouthaving to “know” any working details about the other program or theservice itself. In a client/server architecture, particularly anetworked system, a client is usually a computer that accesses sharednetwork resources provided by another computer (i.e., a server).

Client and server communicate with one another utilizing thefunctionality provided by Hypertext-Transfer Protocol (HTTP). The WorldWide Web (WWW) or, simply, the “Web,” includes those servers adhering tothis standard (i.e., HTTP) which are accessible to clients via acomputer or data-processing system network address such as a UniformResource Locator (URL). The network address can be referred to as aUniversal Resource Locator address. For example, communication can beprovided over a communications medium. In particular, the client andserver may be coupled to one another via TCP/IP connections forhigh-capacity communication. Active within the client is a firstprocess, known as a “browser,” which establishes the connection with theserver and presents information to the user. The server itself executescorresponding server software that presents information to the client inthe form of HTTP responses. The HTTP responses correspond to “web pages”constructed from a Hypertext Markup Language (HTML), or otherserver-generated data. Each web page can also be referred to simply as a“page.”

The client typically displays the information provided through thenetwork by the server, using a software application known as a browser.Most browsers have modern graphical user interfaces that are capable ofdisplaying and manipulating various types of data. A graphical userinterface is a type of display format that enables a user to choosecommands, start programs, and see lists of files and other options bypointing to pictorial representations (icons) and lists of menu items onthe screen. Choices can be activated generally either with a keyboard ora mouse. Internet services are typically accessed by specifying a uniquenetwork address (i.e., typically with a URL). The URL address has twobasic components, the protocol to be used and the object pathname. Forexample, the URL address, “http://www.uspto.gov” (i.e., home page forthe U.S. Patent and Trademark Office), specifies a HTTP and a pathnameof the server (“www.uspto.gov”). The server name is associated with oneor more equivalent TCP/IP addresses.

Neural Network Analysis

Neural network analysis is a method of modeling non-linear relationshipsbetween independent and dependent variables. The analysis is performedby creating a network that accurately models the relationship betweenthe independent and dependent variables. Once a valid neural network iscreated it can be used to predict values of unknown, dependent variableson the basis of known, independent variables. By convention, in neuralnetwork analysis, independent variables are called inputs and dependentvariables are called outputs.

The power of a neural network lies in the non-linear equation (s) thatit uses to model the relationship(s) between the inputs and the outputs.The equation is a complex function that is defined by a set of variablescalled connection weights. Specific values for the connection weightsare determined by a training algorithm which examines a set of trainingdata. The training data is a set of inputs and associated outputs thatare representative of the nonlinear relationship being modeled. Thetraining algorithm processes the training data inputs and finds a set ofconnection weights that minimize the error between the predicted outputof the neural network and the training data output.

A neural network is structurally comprised of an input layer, one ormore hidden layers, and an output layer. The output and hidden layersare comprised of interconnected processing elements, which are the mainbuilding blocks of the neural network. The primary function of the inputlayer is to route input values to processing elements of the firsthidden layer. Each processing element multiplies each input by adifferent connection weight value to obtain a product and then sums theindividual products. The results are passed through a non-lineartransfer function to produce a processing element output. All processingelement outputs of one layer are routed to processing element inputs ofthe next layer where similar processing is repeated. The final layer ina neural network is the output layer and it may contain linear and/ornon-linear processing elements. Non-linear processing elements processinputs in the same manner described above. Linear processing elementssimply pass the input of the processing element to the output of theprocessing element. The outputs of the processing elements in the outputlayer produce the final output of the neural network.

Other neural network design considerations include whether the neuralnetwork is a fully connected and/or a feedforward design. A neuralnetwork is fully connected if all outputs from one layer are used asinputs to the next layer. A neural network is feedforward if there areno internal feedback loops (i.e., no outputs from one layer are used asinputs to a previous layer).

The first step in creating a neural network is to define what is to beoutput. These outputs will be the final outputs of the neural network.The next step is to identify all variables that will materiallyinfluence the value of the outputs. These variables will be the inputsto the neural network. Once the network inputs and outputs have beenidentified the remaining structure of the neural network, including thenumber of layers and the number of processing elements in each layer,may be determined.

Once the structure of the neural network is determined, the neuralnetwork can be created. After creation, the neural network is trainedusing training data. Training data is a set of data, including inputvariables and associated output variables, which represent thestatistical relationship(s) to be modeled by the neural network. Themore training data collected and used the better, particularly if therelationship(s) being modeled is statistical in nature.

Training is accomplished by a training algorithm that is implemented bythe neural network. The training algorithm processes the training dataand selects appropriate connection weights that most closely model therelationship between the training data inputs and the training dataoutputs.

Once trained, the performance of the neural network can be evaluatedusing test data. Testing a neural network is accomplished as follows.Test data inputs are individually input into the neural network. Theneural network is run and predicted outputs are generated for each testinput. The predicted outputs are compared to actual test data outputs todetermine if the neural network is performing properly. A neural networkthat performs poorly on test data should not be used.

After a neural network is trained it can be used to predict outputsbased on various inputs. The resulting predictions then can be used forthe purpose for which the neural network was designed. Examples ofneural networks are shown and described in U.S. Pat. No. 5,724,258titled “Neural Network Analysis For Multifocal Contact Lens Design,” andU.S. Pat. No. 5,839,438 titled “Computer-based Neural Network System andMethod for Medical Diagnosis and Interpretation,” both of which areincorporated herein fully by reference. Other details and principlesregarding neural networks are set forth in “Artificial Neural Networks,”Robert J. Schalkoff (McGraw-Hill, 1997), the contents of which also areincorporated herein fully by reference.

Existing Product Recommendation Systems

The rise of the Internet and its role in e-commerce has resulted in anumber of product recommendation systems and methods being developed.Most of these systems share one or more of the following objectives andapproaches. First, the systems attempt to help each customer find asmall, more manageable sub-set of products that may be more valuable tohim or her from amongst thousands of products. In most cases, a customersimply could not browse the product descriptions of the complete set ofproducts; and even if they could, the product descriptions do notcontain enough relevant information to enable the customer to assess thevalue of a specific product with respect to his or her concerns andinterests. Second, the systems seek to determine the customer's specificproduct preferences by analyzing the customer's purchase behavior andproduct usage feedback. This kind of information extends that availablefrom simple, explicit customer profiles generated through surveys.Third, the recommendation systems seek to exploit information from othercustomers that is similar to a given customer in some form or another.

Many of these recommendation systems utilize techniques such ascollaborative or content-based filtering to supplement informationavailable about a customer's individual behavior. The success of systemsusing techniques like filtering hinge on the assumption (reasonable inmany circumstances) that there is a material degree of overlap in theinterests, concerns, and characteristics of the numerous customersserved by the systems. However, it is often technically challenging todefine the appropriate group or “neighborhood” of similar customers fora given customer, and also to then predict the individual's preferencesfrom those in the neighborhood with present recommendation systems.Finally, some of the present recommendation systems periodically adaptthe recommendations to incorporate ongoing customer experience andbehavior, though in a very limited and simple fashion.

General categories of existing product recommendation systems follow. Itshould be noted however that many of the present systems do not fallneatly into any single category. Also, the following few categories arenot intended to be exhaustive.

One type of existing product recommendation system is a non-personalizedrecommendation system. Non-personalized systems recommend products toindividual consumers based on averaged information about the productsprovided by other consumers. Examples of non-personalized productrecommendation systems are those of Amazon.com and Moviefinder.com. Thesame product recommendations are made to all consumers seekinginformation about a particular product(s) and all productrecommendations are completely independent of any particular consumer.

Another type of existing product recommendation system employsitem-to-item correlation to formulate recommendations. Item-to-itemsystems recommend other products to an individual consumer based onrelationships between products already purchased by the consumer or forwhich the consumer has expressed an interest. The relationships employedtypically are brand identity, fragrance, sales appeal, marketdistribution, and the like. In all cases the information on which therelationships are based is implicit. In other words, no explicit inputregarding what the consumer is looking for or prefers is solicited bythese systems. Rather, techniques such as data mining are employed tofind implicit relationships between products for which the individualconsumer has expressed a preference and other products available forpurchase. The actual performance of products or whether the consumer (orother consumers) ultimately did prefer the products purchased play nopart in formulating recommendations with these types of systems.

A third type of existing product recommendation system is anattribute-based system. Attribute-based recommendation systems utilizesyntactic properties or descriptive “content” of available products toformulate their recommendations. In other words, attribute-based systemsassume that the attributes of products are easily classified and that anindividual consumer knows which classification he or she should purchasewithout help or input from the recommendation system. An exemplaryattribute-based recommendation system is the MOVIE MAP service offeredby Reel.com. With the MOVIE MAP service the recommendations presentedare based solely on the category of movie selected by the consumer. Oneof the major shortcomings of attribute-based systems is that there isoften confusion among consumers and/or professionals about the properclassification of attributes to achieve successful recommendations. Forexample, in the case of automobile wax for an older vehicle there isdisagreement over whether a silicone- or wax-based cream or lotion willprovide optimal results.

In the area of product recommendation systems collaborative filteringhas proven more reliable than content-based filtering. Nonetheless, bothwill be discussed as certain embodiments of the present invention mayutilize one and/or both types of filters.

Content-Based Filtering

FIG. 1 illustrates some of the principles behind content-basedfiltering. Matrix 100 is shown for a single user. The prediction isblind to data from other users, and the system assumes all productratings are binary (i.e., positive or negative). The matrix is notsparse. Assuming the category 102 is soap (S), a content-based filteringtechnique examines matrix 100 to identify the features (cost 103,fragrance 104, viscosity 105, and the like) associated with the products110 a-110 l having a rating 101 by the user (e.g., 110 b-c, 110 e, 110g, and 110 k). The appropriate features 103-105 are then used tocharacterize the user. Predicted ratings 101 for products not actuallyrated by the user (e.g., products 110 a, 110 d, 110 f, 110 h j, and 110l) are then mapped into the feature space based on their proximity toclusters of rated products. For example, it can be deduced from theinformation about the rated products in the matrix that the consumer itcharacterizes generally prefers soaps with higher cost 103 (ranked from1 to 10, 1 representing least expensive and 10 representing mostexpensive) and have an unscented (US) fragrance 104 (scented=V and wildberry scents=WB). Therefore, although the user characterized by matrix100 has not actually rated product 110 a one might predict usingcontent-based filtering that because product 110 a is unscented andmoderately expensively the user would rate product 110 a favorably.Note, there are many techniques for determining the appropriate productfeatures to populate a feature space accurately reflecting theindividual user, and features may be added or deleted over time as thesystem learns more about a particular user or the user's preferenceschange.

Collaborative Filtering

Collaborative filtering (also referred to as social-informationfiltering) on the other hand, typically records an extended productpreference set that can be matched with a collaborative group. In otherwords, collaborative filters recommend products that “similar users”have rated highly. Often the social-information is a similar pattern ofproduct preferences.

FIG. 2 illustrates some of the principles underlying collaborativefiltering. Once again binary product ratings are assumed. Grid 200 iscomprised of product columns 201 a-201 l and user rows 202 a-202 p. Ifthe system possesses any rating data for a particular product and user,that data is entered in grid 200 at the cell formed by the intersectionof the appropriate product column and user row. For example, from grid200 it can be seen that user 202 a rated product 201 a positively. Withall the rating data entered in matrix 200 one still expects it to besparsely populated. The goal of a collaborative filter is to fill in thecells having no ratings data with accurate predictions based on theratings given by similar users mapped in matrix 200. Consider targetuser 202 i, whose ratings for products 201 a-l are enclosed in circle203. Collaborative filtering identifies user 202 o as being similar totarget user 202 i in his or her ratings of products 202 a-p (indicatedby arrow 204). Based on this similarity the system might predict thatlike user 202 o, target user 202 i would rate product 201 l positivelyas well if he or she actually used it. The system therefore mayrecommend product 201 l to target user 202 i. One skilled in the art ofcollaborative filters will appreciate that a number of techniques existfor generating predictions based on multiple similar users, forselecting appropriate subsets of nearest neighbors on which to basepredictions, for incorporating real-valued ratings in the process, andfor making real-valued predictions.

Attempts have been made to combine collaborative and content-basedfiltering in a single system. Combining collaborative and content-basedfiltering resulted in improved collaborative filtering predictions wherethe user database was segmented in accordance with content-basedfilters. An exemplary combined system is described in “Recommendation asClassification: Using Social and Content-Based Information inRecommendation,” Proceedings of the Fifteenth National Conference onArtificial Intelligence (AAAI-98), (Basu, C.; Hirsh, H.; and Cohen, W.;1998), where collaborative filtering augmented by content-basedproperties is used to predict movie recommendations. The content-basedproperties were in a database and included personnel (i.e., actors,directors, and the like), genre, language, and length of the movies.Improved collaborative filtering results were achieved when the userdatabase was segmented on the genre of movie favored by the particularuser being served. Another example of a combined content-based andcollaborative filtering recommendation system is described in “CombiningContent-Based and Collaborative Recommendation,” Communications of theACM, (Balabanovic, M.; Shoham, Y.; 1997)(http://citeseer.nj.nec.com/balabanovic97combining.html). TheBalabanovic and Shoham system uses content-based and collaborativefiltering to learn user interest in Internet document fetching andrecommends pre-fetch web pages for the user.

Problem Summary

Thus, it is apparent from the foregoing discussion that a number ofproduct recommendation systems employing numerous techniques exist inthe art. However, it is also readily apparent that presentrecommendation systems have significant shortcomings. For instance, manyif not most of the products to be considered for a particular consumermay not have been used and rated by many other consumers therebyhandicapping collaborative filtering based systems. Also, consumersoften have great difficulty in knowing or determining whether some, all,or none of their needs are being met by a particular product he or shemay be using. This is particularly true where the need being addressedby a product is characterized by an incremental response. Moreover,while existing systems may be helpful in some categories of productsthey are inappropriate where performance of the products beingrecommended is complex or even unknown. Placing a high value on theratings patterns of other consumers, even though similar in asocial-statistical sense, fails to address the likelihood that theconsumers may have disparate underlying conditions and problems to beaddressed by a product, and that the condition or problem being treatedby the product may respond quite differently. In many categories theperformance of products cannot be reliably predicted based on ratingspatterns of other similar users, promises by the manufacturers thereof,or an examination of the ingredients or makeup of the products.

Accordingly, a need exists in the art for an individualized productrecommendation system that does not rely primarily on consumer selectionpatterns but rather on product performance, optimized segmentationbases, and/or performance-based learning to render highly accurateproduct recommendations.

III. SUMMARY

The present invention contemplates systems and methods of utilizingcommunications networks and recommendation processing operating onmultivariate data characterizing consumers and products. The processingcapability of the invention is based on intelligence contained in theprocessing computation design and algorithms. The data comprisessubjective and/or objective product information received from consumersor input to the system as part of its initial setup and characterizationof consumers that allow finding commonalties among the consumers interms of similar requirements or responses. In one embodiment of theinvention the data processing portion of the system receives input fromconsumers via the Internet. The output(s) of the system comprise sets ofproducts that it predicts the consumer will prefer and/or perform wellfor the problem or concern identified by the consumer. Objective productinformation is generally obtained with diagnostic instruments thatmeasure parameters having scientific relationship to human concernsregarding a target substrate and/or that correlate with subjectiveperformance assessments. Data measured with the diagnostic instrumentsmay be communicated to the data processing portions of the invention viathe Internet. The diagnostic instruments may be interfaced directly tothe Internet. The outputs of the data processing portion of the system,the product recommendations and/or ancillary information, may bepresented to consumers via the Internet as well.

The data processing portion of the invention may include a neuralnetwork. The neural network is used to model the relationship(s)(typically non-linear) between the input variables of a servedconsumer's descriptive variables and the performance and/or preferenceresponses of other consumers to products they have used in combinationwith the descriptive characterization of those consumers, and outputvariables of individual product performance and/or preferencepredictions. The neural network may be trained using actual productperformance and preference data of a subset of a relevant population. Italso may use as input product data (called product attributes) averagedover a group or segment of the consumer population along with adescriptive characterization of the group or segment to effectivelyreduce the complexity of the neural network. In certain embodiments ofthe invention the neural network is periodically re-trained through anexplicit process of evaluation and optimization utilizing comparisons ofpredicted preference and performance versus actual preference andperformance data collected from users of the invention.

Embodiments of the invention may utilize collaborative and/orcontent-based filters in the recommendation engine. Neighborhoodformation in the collaborative filters may be based on a space composedof a plurality of items, including individual concern parameters,category target conditions, patterns of performance responses toproducts, product preference patterns, product preference issues, andthe like.

Through objective and/or subjective feedback inputs, certain embodimentsof the invention obtain data on the real world performance of products,the condition of the target substrates treated, and substrate responsesto product use. Various embodiments of the invention use thisinformation, aggregated from many consumers, to recommend products toother consumers having a basis for similar responses. The basis forsimilarity may comprise concerns and conditions on an individualizedbasis. The invention may obtain this information across a practicallyunlimited range of consumers and for any manufacturers' products. Theinvention is intended to be unbiased as to manufacturer identity orcommercial intent, recommending products to a consumer based solely onthe consumer desires in terms of performance, cost, preference, and thelike.

The invention may periodically re-train its data processing portions tomore accurately predict product performances and consumer preferences.When the embodiment of the invention utilizes re-training, as thenumbers of consumers and multiple feedback entries accumulate, theinvention acquires greater precision based on the real world experiencesof those consumers. This added precision often allows the invention todifferentiate between the products used in a given category, which maybe of more value to a consumer than single product and small base sizestudies typical of commercial claim support and single product clinicaltrials. Where objective data is gathered, the invention may identifycorrelation or other relationships with consumer concerns to createperformance response models based on the objective data.

Embodiments of the invention may collect data on consumer demographicsand substrate needs, including consumer preferences for products, thecurrent and historical condition of the substrate to be treated (e.g.,consumer's skin), and responses of the substrate to current andhistorical product uses. For some purposes, such as creating informationof use in category-related industries, the invention also may collectdata on the mean effects of products within predefined or naturallyclustering sub-populations of consumers called groups or segments.Segments are characterized by their similarity of needs or responses toproducts. In some embodiments of the invention, product recommendationcan be formed on the basis of a consumer's characterization similarityto segment characterizations and the segments' average responses toproducts. Segments may be dynamically defined through re-training. Otherembodiments generate data used for making recommendations on the basisof feedback responses to products among dynamically constructed consumerneighborhoods defined by collaborative filtering. Individual consumersalso may have access to a variety of information concerning theperformance of their current or historical products and/or obtain systempredictions of performance and preference of hypothetical use ofavailable products.

IV. BRIEF DESCRIPTION OF THE DRAWINGS

These and other features, aspects, and advantages of the invention willbecome better understood in connection with the appended claims and thefollowing description and drawings of various embodiments of theinvention where:

FIG. 1 shows a matrix that illustrates several principles associatedwith conventional content-based filtering techniques;

FIG. 2 shows a feature space that illustrates several principlesassociated with conventional collaborative filtering techniques;

FIG. 3 illustrates a first exemplary network environment in which thepresent invention may be employed;

FIG. 4 illustrates a second exemplary network environment in which thepresent invention may be employed;

FIG. 5 illustrates a query structure for gathering invention input froma consumer in accordance with an embodiment of the invention;

FIG. 6 illustrates a consumer database entry in accordance with anembodiment of the invention;

FIG. 7 illustrates in functional form how certain embodiments of theinvention operate when diagnostic data is incorporated therein;

FIGS. 8A and 8B illustrate exemplary top-3 recommended product listsrank ordered by predicted product preference scores;

FIGS. 9A and 9B illustrate exemplary top-3 recommended product listsrank ordered by predicted product performance scores;

FIG. 10 illustrates in functional form how a product recommendationengine utilizing a neural network operates in accordance with anembodiment of the invention;

FIG. 11 illustrates a cascade of collaborative and content-based filtersthat may be employed in a product recommendation engine in accordancewith an embodiment of the invention;

FIG. 12 illustrates in functional form how feedback is utilized incertain embodiments of the invention;

FIG. 13 illustrates in functional form how an exemplary professionalonly embodiment of the invention operates;

FIG. 14 illustrates in functional form how an exemplary professionalauthorized access embodiment of the invention operates;

FIG. 15 illustrates in functional form how a first exemplary hybridprofessional only embodiment of the invention operates;

FIG. 16 illustrates a generalized process of a consumer interacting withan embodiment of the invention;

FIGS. 17A and 17B illustrate in flow diagram form a process forinteracting with an embodiment of the invention;

FIG. 18 illustrates in flow diagram form a process for re-training therecommendation engine in accordance with an embodiment of the invention;and

FIG. 19 illustrates an exemplary system incorporating an embodiment ofthe invention and a plurality of revenue stream generation points withinthe system.

V. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Throughout the following detailed description similar reference numbersrefer to similar elements in all the drawings. Also, embodiments of theinvention are discussed and described herein for the most part in termsof skin care and skin care products. The invention, however, is in noway limited to skin care or skin care products. Rather, the invention isbroadly applicable to a vast array of target substrates and productcategories.

Exemplary Systems

FIGS. 3 and 4 illustrate first and second exemplary network environmentsrespectively in which the present invention may reside. Of course,actual network environments may be arranged in a variety ofconfigurations and the invention is in no way intended to be limited tothe embodiments depicted and described herein. The environmentillustrated in FIG. 3 is that of a client-server system 300. System 300includes client computers 320, 320 a, which could be personal computers,thin clients, hand-held computing devices, and the like. System 300 alsoincludes at least one server computer 322 and storage element 370 whichis coupled to and controlled by server computer 322. The client andserver computers in system 300 communicate with each other by way ofcommunications network 380, which may comprise any number of networkingtechnologies such as a LAN, a WAN, an intranet, the Internet, and thelike.

Client computers 320, 320 a and server computer 322 are connected tocommunications network 380 by way of communications interfaces 382.Communications interfaces 382 can be any one of the well-knowncommunications interfaces such as Ethernet connections, modemconnections, DSL connections, cable modem connections, and the like.Communications interfaces 382 also may comprise intermediatecommunications networks such as a LAN.

FIG. 4 illustrates a second exemplary network environment in which theinvention may reside. System 400 is comprised of the three basiccomponents forming commonly implemented architectures for serving webpages (or in general, Internet connectivity): the public network 401, ademilitarized zone (“DMZ”) 402, and a private network 403. The purposeof separating the private network from the public network is to providea predetermined level of information security.

In most embodiments of the invention the public network 401 willcomprise the Internet. Because security threats typically reside in thepublic network a software and/or hardware device called a firewall 404is placed along the connection point between the Internet and theprivate network. The firewall 404 blocks all traffic from the publicnetwork to the private network except for predefined types of messagingtraffic such as web access to a defined set of web servers 405. Theportion of the system 400 including the firewall typically is referredto as the DMZ because the resources it contains are only partiallyprotected from outside access.

In certain embodiments of the invention another firewall 406 is placedbetween the DMZ 402 and the private (strictly internal) network 403.This second firewall allows access to the internal network only frommachines in the DMZ utilizing a specific predefined type(s) of messagingtraffic.

Static data to be served by the system can be placed in either theinternal network or in the DMZ. Typically the static data is placed inthe DMZ since it is often directly attached to the web servers. Insystem 400 however, the static data is stored on Network AttachedStorage (NAS) 407 which resides in the private network zone. Anadvantage of NAS is that the storage has its own network address andhence the disks can be shared efficiently across multiple computers andis highly scalable. Static data may include, but is not limited to,content served when of interest to consumers, information andinstructions, standard page formats into which individualized data,information and charts can be inserted, and the like.

Dynamic content (e.g., user-specific information) may also be stored inthe NAS 407. However, because dynamic content is likely to be managedusing a Database Management System (DBMS) such as Oracle or SQL Serversystem 400 employs a separate DBMS server 408 for dynamic content. Useof a separate DBMS server for dynamic content may also be necessary dueto the processing requirements involved in the manipulation of data insystem 400 and to further support database scalability.

System 400 also utilizes a site update subsystem 409. Site updatesubsystem may be used to update the static content of the web site aswell as the content stored in the database. While depicted in system 400as a function dedicated to a single computer, this is a standard website update function and the specific update procedures and locationsare matters of design choice.

Firewalls 404 and 406 may be implemented as either hardware orcombination of hardware and software. Many firewalls today areimplemented through software running on a relatively small server. SunMicrosystems offers many types of suitable small servers for thisfunction and Check Point Software Technologies, Inc. offers a popularsoftware package having suitable firewall functionality. An alternativeconfiguration of system 400 may be implemented by having the firewallsoftware residing on the small server perform the DMZ function as well,thereby eliminating the need for additional DMZ hardware.

The purpose of the web switch 410 in the DMZ 402 is to provide loadbalancing across the multiple web servers 405 within the DMZ 402. A webswitch 410 may or may not be required in system 400. The selection ofthe web switch 410 and web servers 405 are matters of design choice andnumerous vendors offer suitable platforms and packages. Therecommendation engine processors 411 perform the processor-intensiveoff-line calculations needed to generate the individualized productrecommendations. Selection of the recommendation engine processors is amatter of design choice as well.

In system 300, consumers use client computers 320, 320 a to communicatesubjective and/or objective data 310 to server 322. Server 322 then actsupon and/or stores the consumer data in data storage element 370. Server322 uses the consumer data as well as other information stored instorage 370 to generate product recommendations 314 (as described morefully below). The product recommendations 314 are typically deliveredover communications network 380 for presentation to the consumer at therequesting client computer 320, 320 a.

In system 400, on the other hand, consumers transmit the subjectiveand/or objective data 310 to the web servers 405 within the DMZ 402 viathe public network 401. The consumer data is then transferred by the webservers 405 to the various elements within the private network 403 asappropriate. The product recommendation processors 411, drawing on theconsumer data, as well as other data stored on elements within theprivate network such as the NAS 407 and the DBMS 408, generate productrecommendations. The product recommendations are then communicated toconsumers via the DMZ 402 and public network 401.

The product recommendations typically comprise predicted productperformance and product preference scores for a plurality of productsfor a particular consumer. In certain embodiments of the invention therecommendations are in the form of a custom constructed HTML document, astatic HTML document into which custom constructed text, data graphicsor charts are inserted, and the like. The HTML document also may includeproduct package illustrations and information on the recommendedproducts, as well as radio button options such as “add to my cart,”“sample,” “add to my reminder list”, and the like next to eachrecommended product. A “rate this product” radio button also may beincorporated in the HTML document to permit the consumer to input his orher opinion of recommended products based on their historical use of theproduct. If a consumer has previously rated any of the recommended setpoorly, the system may be programmed so that those products are excludedfrom a future recommended set for that consumer. In some cases theproduct recommendation engine determines whether the set of priorproduct responses indicates likely rejection or downgrading of otherproducts that may be related on some basis.

Consumers also may request and/or systems 300 and 400 may deliverinformation in addition to the pure product recommendations. Thisancillary information may cover any number of topics related to theproduct recommendations such as the needs of a consumer, and the like.Product recommendations and ancillary information will be discussed ifmore detail below in conjunction with system outputs.

The bases for the product recommendations may include, but are notlimited to: a) descriptions of product attributes residing withinstorage elements in communication with the data processing orrecommendation engine portions of the invention (e.g., storage element370, NAS 407, DBMS 408, and the like); b) detailed information abouteach characteristic of a particular consumer's interests, including butnot limited to his or her requirements, budget, aesthetic preferences,health needs, and/or need importances; c) other stored historicalproduct data relating to the consumer's purchase patterns and pastresponses to products; d) similar information on some or all otherconsumers who have used the invention; and/or e) the productrecommendation engine (which may utilize a neural network, acollaborative filter, combinations thereof, and the like) which infersthe predicted performance and/or preference for products for anindividual consumer based on the data and processing elements describedabove. Inputs and data incorporated within and utilized by the variouselements of the invention will be discussed in more detail below.

The accuracy of the inputs to and outputs of the invention may beimproved in a number of ways. One way is to include objective measuresof substrate parameters that correlate with concerns of the consumers.These objective, physical measurements may be used to augment thesubjective inputs (e.g., needs input variables and product performanceratings), or may even displace certain subjective consumer inputsaltogether.

A second way to improve the accuracy of invention outputs is toperiodically re-train the recommendation engine so that its outputscorrelate more closely with data gathered by the system through consumerfeedback. For instance, where the recommendation engine utilizes aneural network, predictions and actual consumer responses to product useare used periodically to re-train the algorithms residing in the hiddenlayers so that its future outputs (e.g., product recommendations)correlate more closely with the consumer feedback. Similarly, where therecommendation engine utilizes collaborative filtering one re-trainingoptimization routine uses actual consumer feedback to refine the size ofcollaborative neighborhoods used if this is a fixed parameter, adjustthe coefficients that scale each dimension of the collaborative space,and evaluate whether secondary collaborative filtering classificationssuch as performance or preference patterns improve accuracy of outputs.

Inputs

Inputs into the invention will now be considered. Query forms may beused to solicit the various inputs into the system from consumers. FIG.5 illustrates an exemplary initial query structure. FIG. 6 illustratessome of the data that may be included in an individual consumer databaseentry within systems employing the invention.

In the initial or early interactions with a new consumer, the inventionsolicits personal profile information (e.g., age, gender, sleeppatterns, medical conditions, prescription drug use, known allergies,geographic location, time spent outdoors, vitamin use, diet, and thelike) and target concerns from the consumer. Personal profileinformation is gathered in certain embodiments of the invention becausebased on best knowledge of a category target's area of productsresearch, such information may contribute to generating individualizedproduct recommendations.

In general, when a consumer interacts with the invention he or she maybe provided the option to either update his or her current needs, inputproduct responses, obtain information content or ancillary informationrelating to a covered area, obtain information on their responses toproducts over time, and/or obtain recommendations for products in one ofthe categories covered by the invention. The latter three options areinvention outputs and will be considered below. Consumer needs data isan invention input and may comprise subjective data about the conditionof a target substrate. Subjective consumer needs data may also beaugmented and/or supplanted by objective measurements gathered withdiagnostic tools. Product responses are also system inputs and maycomprise subjective and/or objective data regarding response of asubstrate to whatever product the consumer is using whether previouslyrecommended or not.

Upon receipt of product responses from consumers, the recommendationengine or processing associated therewith performs any number ofoperations on or with the data. For instance, and by way of exampleonly, individual consumer profiles may be updated to include theobjective and/or subjective data, modifications to various processinginputs such as consumer needs data may be calculated and implemented,and the like. The invention may also use product responses or feedbackto: a) group consumers with similar substrate conditions; b) groupconsumers whose substrate responds better to the same set of products;c) group consumers whose substrate responds by a similar magnitude tothe same set of products; d) measure the effects of products onsubstrate properties; e) compare the effects on a single consumer'ssubstrate to the average effects seen in a population of consumers;and/or f) show consumers any changes that have occurred with use of aparticular product or products over time. The use of feedback isdiscussed in greater detail below.

Consumers often have product choice biases based on aesthetic choicessuch as fragrance character or level, product form (e.g., cream vs.lotion, spray vs. roll-on, and the like), genre of entertainment,hardcover or soft, and the like. Certain embodiments of the inventiongather aesthetic choice information from a consumer because suchinformation may provide a basis for an operator of systems employing theinvention to check for product preference scatter depending on thesebiases. Where there are preference dependencies among consumers on thebasis of such variables, certain embodiments of the invention may groupan individual consumer with an appropriate class of individuals beforecalculating predicted product preferences and product recommendations.

In certain embodiments of the invention a consumer may have more thanone concern or problem at a time regarding the target or substratetreated in a category of products (also referred to herein as a categorytarget). Each concern for a particular target substrate is characterizedin terms of the consumer's assessment of the concern's severity and/orimportance. Typically, severity represents a subjective self-assessedlevel of the problem. In some cases however, severity may be assessed byothers, and/or based upon measures of related physical properties orsigns (e.g., diagnostic data). Importance typically is the degree towhich a consumer is bothered or frustrated by the concern. Importancemay also be thought of as extent to which the consumer would trade offbenefits to meet their expectations from a product. (Hypotheticalbenefits of lesser importance would be sacrificed before benefits ofhigher importance.) The magnitude of severities and importances arepreferred consumer characterization inputs for the system. The rankorder of importances may be useful secondary consumer characterizationinputs. Importance and severity are treated as independent factors inpreferred embodiments of the invention.

A consumer's experience with a product also may be solicited. In certainembodiments of the invention consumer experiences are recorded in termsof preference and/or performance metrics. Solicitation of bothpreference and performance are preferred. Preference can be thought ofas the answer to the question, “How much did you like using theproduct?”Preference should reflect the user's overall experience, andmay include factors related to any perceived improvement in theconsumer's various concerns, as well as more subjective aestheticfactors such as fragrance, ease of application, flavor, attractivenessof packaging, and the like. Performance should rate the extent to whicha product reduced the signs or other conditions or symptoms associatedwith each concern in a category. While performance may compriseobjective and/or subjective components, the inclusion of objective datais preferred. In situations where multiple products are used incombination by a single consumer, certain embodiments of the inventiondo not distinguish between the relative preference and performanceratings of each product but ascribe the ratings to all the components ofthe set.

Diagnostic data refers to objective data characterizing the state of asubstrate to be treated by products in a given category. Substrates canbe animate or inanimate, including an aspect of the consumer's person.In addition to diagnostic data, clients and/or their professionalservice providers may provide subjective characterization of substrateconditions and substrate performance responses to product use.Diagnostic data is obtained from a measurement tool(s) that measures aproperty related to a concern of the consumer. The property may be anyphysical property of the substrate such as size, mass, mechanical,electrical, optical, and the like. Bulk property examples from each ofthese categories could be length, weight, stiffness, resistance,opacity, and the like. Other properties relating to a substrate orfeature within a substrate might include position, velocity,acceleration, vibration, rotational velocity, orientation, and the like.Surface properties of a substrate may include roughness, friction,reflectance, dryness, discoloration, and the like. Diagnostic data alsomay be based on chemical analyses. The specific properties measured bythe diagnostic tool(s) will vary depending on the substrate beingconsidered. Any time dependence of a measured property may be animportant aspect related to a concern or consumers.

When properties of a substrate being considered are spatiallynon-homogeneous, the range or distribution of the properties may becaptured by taking either randomly located repeated measures (sampling)or location specific measurements (mapping or imaging). Depending on thesubstrate attribute of concern, different functions of the distributeddata correlate with the subjective or perceived attribute of concern.For example, where skin is the substrate and aged appearance is theconsumer concern, wrinkle length could be measured from images of theface. Where the invention utilizes images the diagnostic tool maycomprise a camera, including but not limited to, a digital camera.Diagnostic data for use with the invention may also be multidimensional,meaning a collection of measurements on one or more aspects of thetarget substrate. Collection of multidimensional data is achieved usinga collection of devices, devices having multiple sensors, and/orcombinations thereof.

Literature in the fields of psychometrics and objective measurements isextensive and may be consulted in formulating new functions of single ormultiple diagnostic measures that correlate with various features ofconsumer concern and the desired effects of products in a category. Insome cases though, it may be easier to measure the objective effects onthe consumer rather than properties of the substrate. For example, wherethe consumer concern is “comfort of a bed” the relationship may bemodeled by a complex function of optimal softness of the surface andstiffness of the support. Alternatively, one could measure directly onthe consumer their time to fall asleep or hours of REM sleep and developa model that relates this to the judged “comfort of a bed.”

The parameters and/or sets of parameters to be measured with thediagnostic tools must be relevant to issues of consumer interest for aparticular substrate. Multiple parameters can be communicated to thedata processing elements of the invention individually or incombination. Alternatively, multiple parameters measured by a diagnostictool(s) could be combined linearly and/or non-linearly at the clientsite to form an overall functional parameter that is communicated to thedata processing elements on the server side of the system.

Only as many variables need to be measured as are necessary to formulatea reasonably predictive model of the consumer concern. In many cases,only a single variable selected from a plurality of options isnecessary. Specific parameters and combinations of parameters that couldbe measured where the target substrate comprises skin, by way of exampleonly, include the following. A consumer concern of skin dryness couldinvolve any combination of surface reflectance, redness, skin moisturecontent (capacitance, conductance), skin barrier function (TEWL orchange in moisture following wetting), friction, epidermal hyperplasia,skin flake image analysis, and the like. Skin lesion monitoring couldinvolve any combination of size of specific lesions, color or specificlesions, and the body site of specific lesions. Skin solar exposuremonitoring could involve any combination of basal skin color, pigmentedspot color, contrast, and the like. Visible or ultraviolet light may beused to measure reflectance or fluorescence changes. Skin agingmonitoring could involve any combination of skin color, skin colorevenness, skin wrinkle length or depth, skin sagging, skin rigidity, andskin hydration.

Other specific parameters and combinations of parameters that could bemeasured where the target substrate comprises skin include: hair color,hair thickness, hair density, hair growth, acne lesion counts, acnelesion color, acne lesion rate of change, hyperpigmentation size andarea, hyperpigmentation count, hyperpigmentation color, cytology ofsurface corneocytes (size, shape, and/or nucleation), electricalconductivity, capacitance, mechanical stiffness in the plane of thesurface and/or perpendicular to the surface, friction, characterizationof the fluorescence of skin, optical reflectivity as a function ofcolor, microbial detection, optically based determination ofdistribution of pigmentation or photo damage, surface energy by contactangle, 3-D contour determination of sagging or bags under the eyes,redness, discoloration, and/or wrinkle depth and/or length.

Implementations of the invention incorporating objective data, like thatdiscussed above, typically involve the use of diagnostic tools. Theseembodiments of the invention use diagnostic tools to obtain objectivemeasurements that help dimension the needs levels of consumers (systeminput) and/or track the responses of a substrate to a particular product(performance feedback). An example of the former is objective data beingused to adjust a consumer's subjectively assessed concern severity inone or more concern areas. Diagnostic tools typically are located at theclient side of the communications network at a consumer's home, aservice center accessible to the consumer, a physician's office, and thelike. Utilization of diagnostic tools improves system sensitivity toeffects of the products and provides objective data on the condition ofthe target to be treated by the product. The diagnostic data obtainedwith a diagnostic tool is communicated to the recommendation engine viacommunications network 380 (in system 300), public network and DMZ (insystem 400), or other similar means of communication. The diagnostictools and/or sensors employed therein to obtain the diagnostic data mayrequire periodic calibration to assure continued accuracy. Calibrationcan be internal to a device, involve automatic adjustments when acalibration substrate is used, or be performed manually.

FIG. 7 illustrates in functional form how certain embodiments of theinvention 700 may operate when diagnostic data is incorporated therein.Block 701 represents product attribute data gathered by the system ofthe invention 700 (or in the case of initial system startup, entered aspriming data). Block 702 represents consumer needs data, objectiveand/or subjective feedback (such as diagnostic data), personal profileinformation, and the like solicited or gathered by the system fromconsumers using system 700. Arrow 703 represents the operation of thesystem's product recommendation engine (also referred to herein as theforward intelligence engine) on the system inputs (i.e., blocks 701 and702 information). Block 704 represents the product recommendationsgenerated by the product recommendation engine in arrow 703 and output709 to consumer users of system 700. Block 705 represents the selection,purchase, and use of a product to treat a concern by consumers. Note, asa general matter the product selected and used by the consumers need notbe one of the products recommended by the system 700, or even presentlywithin the knowledge base of the system 700. Consumers may select anduse any product they choose to treat a concern for which they haveidentified to the system 700 (e.g., block 702) and provide feedbackabout that product (e.g., 706, 707, 708). Block 706 represents thesolicitation 710 of diagnostic measurements from the consumers. Blocks707 and 708 represent feedback (e.g., new diagnostic measurements andsubjective responses) received by the system 700 from the consumers andincorporated 712 within the knowledge base of system 700. Block 705 alsorepresents the receipt and consideration of ancillary information output(e.g., diagnostic levels and trends) generated and delivered 711 bysystem 700 from the consumers.

While networked diagnostic devices have been described in the prior art,data collected by such devices has not been used in a productrecommendation system. In the forward or recommending aspect of thesystems for instance, the state or condition and any historicaldiagnostic responses of a substrate measured with the devices may beused to generate product recommendations. In the reverse or re-trainingaspect of the systems, the objective measurements of substrate responsesto products may be used to re-train the product recommendation engine,which may include product attribute refinement, and/or to updateconsumer profiles. Compared to certain subjective assessments,measurements obtained with diagnostic tools often provide earlier andmore accurate assessment of the effects of product usage. Objective datagathered with diagnostic tools may also reveal changes in importantphysical phenomenon otherwise unavailable to a consumer (e.g., changesin density of bacteria in or on a substrate, changes in pH level of asubstrate, and the like).

For a personal or health care category the diagnostic measurement ormultiple measurements might monitor internal or external properties ofthe consumer or the environment. For other categories of products thediagnostic tool may measure the condition or performance of an inanimateobject. Ideally, the tools are made available at all times at the clientsite. The tools can output values that a consumer sends to the inventionby email, data entry section of a web site, telephone, or the like. Theuse of diagnostic tools that are interfaced with a client computer orother electronic device located at a remote site (e.g., client site,kiosk location, professional service provider office, consumer servicecenter, and the like) for automatic downloading of consumer data to theinvention is preferred. In embodiments of the invention where adiagnostic device is remotely located from the data processing portionsof the invention, the data processing portion of the system may performall or most high level processing of the device's output to reduce thecost of the remotely located device. Diagnostic tools also frequentlyincorporate a standardization process.

Outputs

Attention will now be focused on outputs of the system of the invention.The primary output of the invention comprises individualized productrecommendations in a particular category and regarding a particularsubstrate. In most embodiments of the invention, the productrecommendations attempt to address all of a particular consumer'scurrent concerns, and take into account both the severity and importanceof each concern. Typically products are recommended based upon all knowneffects of the product and the consumer's interest in addressing a rangeof problems and tolerance or sensitivity to adverse effects, which arejust additional rows in the concern matrix.

While certain embodiments of the invention explicitly recommend sets ofproducts in which each product in the set is a specialist for a specificconcern, the product recommendations generated by most embodiments ofthe invention are comprised of products in a category that best addressall of a particular consumer's concerns, preferably taking into accounttheir severity and importance. The latter approach is feasible becauseindividual products are either designed or inadvertently affect many ofthe conditions (e.g., acne and oily skin) characterizing targets, andproducts generally address underlying properties or processes that havebroad effects across concerns. When a product is part of a “packagedset” of products intended to be used in combination, certain embodimentsof the invention make recommendations for such “packaged set” productsas part of all categories that the packaged set covers.

With embodiments of the invention incorporating objective data, aparticular consumer who does not provide objective data on his or herconcerns, preferences, and/or the performance of products used may stillobtain product recommendations based on his or her concerns andsubjective preference and performance data. Such recommendations stillbenefit from the data gathered by the invention from other consumers. Inthese embodiments such users may or may not have access to otherfeatures of the invention based on or requiring objective data.

Underlying the individualized product recommendations are a plurality ofpersonal utilities generated by the product recommendation engine for agiven consumer. The personal utilities are unique and may include, byway of example only, scored predicted product performance utilities andscored predicted product preference utilities.

For scored predicted utility scores any number of meaningful scales maybe used. In certain embodiments of the invention however, a scored scaleof 1 through 10 is used where 10 represents the highest level ofpreference or performance and 1 represents the lowest level ofpreference or performance. The highest level of preference orperformance is set by the system administrator in each assessedpreference or performance category and may be unattainable by currentproducts on the market. For example, in terms of performance for skincare products, in the area of moisturization a 10 might represent a highchange in moisture levels in a single day while a 10 might represent a50% improvement in 4 weeks in the area of wrinkle repair. Alternatively,the reported score may have a value that correlates with magnitudes aconsumer uses for subjective assessment of product performance orpreference. Certain embodiments of the invention utilize overallpredicted performance utilities, which are detailed below in connectionwith data processing and the product recommendation engine.

The predicted personal utilities may be used by the system in variousways including, but not limited to, producing any one or more of thefollowing: a rank order listing by utility of product options; a rankorder listing by utility for a top-N set of products; a rank orderlisting by utility for a number of arbitrary products of interest to theconsumer; a bar chart of utilities for products of interest; a personalutility score in a comparison display showing specifications on a numberof products of interest to the consumer; and the like. Performanceattributes for any set of selected or recommended products may beplotted versus the product price, including overall performance of theproducts.

FIGS. 8A and 8B are exemplary output displays of rank order listings fora top-3 set of products by scored predicted preference. FIGS. 9A and 9Bare exemplary output displays of rank order listings for a top-3 set ofproducts by scored predicted performance. Note that even though thedisplays illustrated in FIGS. 8 and 9 are rank ordered by predictedpreference and performance, respectively, each of the displays alsopresent predicted performance and preference respectively for eachproduct in the display. Both utilities need not be presented toconsumers together in the same display. Note also that the displaysdepicted in FIGS. 8 and 9 include a lowest known price for each productlisted. Presentation of this information is optional.

Another output provided by the invention may comprise ancillary data orinformation. Displays of a consumer's condition based on the diagnosticand/or subjective data collected by the system may communicate to theconsumer how the consumer's needs compare to a relevant population, theawareness of the system of their specific needs, how they have respondedto specific products over time, and the like. Graphics may indicatewhich products were being used by a consumer at different periods oftime as well as trend data.

Another form of ancillary information output comprises explanations ofwhy certain products were recommended. For example, performanceprediction metrics may be explained by querying the invention with aradio button or other appropriate interface and the invention couldrespond by providing a table of concern areas ordered by the consumer'simportance and/or performance scores for the particular product beingconsidered for each area of concern.

Where the product recommendations generated by the invention aredelivered to a consumer who has Internet connectivity, the consumer mayact on the recommendations by ordering or purchasing one or more of therecommended products via the Internet. For instance, links to anordering function incorporated in the invention or to another possiblyallied distribution company may comprise ancillary information outputfrom the invention.

Ancillary information output also may include: links to product reviewsfrom consumers with similar substrate needs; directed content based onthe consumer's problem segmentation; information regarding the conditionof a consumer's substrate within a historical framework to showresponses to use of the invention or use of particular products orproduct classes or periods of any particular underlying behavior;information regarding the condition of a consumer's substrate relativeto peers or a relevant population (demographic positioning could bereported within local geographic or limited ethnic or age limits);information regarding changes resulting from new product usage orregimens through images with or without sensitivity enhanced relative togeneral perception; information regarding the dependence of results onusage practices such as frequency of use or use of associated productsor practices; comparison information that aids a consumer insubjectively assessing performance of a product (e.g., before and afterimages of a substrate of concern); and the like. Other ancillaryinformation could include interactive and/or multimedia applicationsand/or displays. For instance, an interactive and/or multimediaapplication could: guide a consumer through the proper use of arecommended or selected product; aid a consumer in assessing theperformance of a product; and the like. Interactive and/or multimediaapplications and/or displays may include text-based chat rooms,video-based chat rooms, streaming media, virtual help, agents,interactors, and the like.

Many targets, for example health based substrates (and in particular theskin) change and age at slow rates. Other target substrates also mayrespond to products over relatively long timetables. Therefore, overshort time frames the desired effects of products may be subtle anddifficult to discern. Thus, another form of ancillary output that may beprovided in certain embodiments of the invention are progressindications. Progress indications, where possible, may enable consumersto better judge product performance, provide an aid to memory, provideearlier decision making on product suitability, encourage compliancewith effective products, and/or discourage continued use of ineffectiveproducts as soon as possible.

With progress indicators, as a consumer uses a product he or she mayview the effects of the product on the category target (e.g., skinproperties, lung functions, and the like). Tracking may be provided forindividual conditions or for an overall condition, in analogy to theoverall performance discussed below. Where provided, condition iscalculated from data that is being tracked at home or with the help ofprofessional service providers. In some cases, a condition may be basedon subjective feedback. For instance, the data may include subjectivefeedback on current severity of each concern of the category, it may bebased on a set of questions about assessable attributes of the target,and/or utilize objective diagnostic measurements. Preferred embodimentsutilize at least some form of objective diagnostic measurements. Foreach of i concerns, the data processing architecture of the inventionproduces a current condition_(i). The condition_(i) may be any model ofthe data obtained by the invention related to concern_(i).

Preferred embodiments of the invention provide progress indicatorsbecause communicating any change in a condition together with typical orexpected changes helps build realistic consumer expectations of productperformance and effects. Possible displays include a curve representingthe average change in condition for consumers starting with conditionlevels similar to the given consumer, and data points or a curve fit tothe data for the given consumer. To illustrate, the typical change curvefor consumers within a normal range of that condition might be flat,whereas a typical change curve for consumers one sigma deviation fromnormal might show improvement occurring over a certain time scale(t_(1/2)).

Data Processing

The details of the forward intelligence or product recommendation enginewill now be provided. As discussed above, one of the possible outputs ofthe invention comprises product recommendations. The invention generatesits recommendations through the use of a product recommendation enginethat performs multivariate modeling and analysis of the independentvariable inputs it receives from consumers. Depending on the embodimentof the invention implemented, the product recommendation engine mayutilize any combination of the inputs discussed above to produce anycombination of the outputs discussed above. In certain embodiments ofthe invention, the product recommendation engine utilizes one or moreneural networks to generate outputs from the inputs. In otherembodiments of the invention, the product recommendation engine utilizesa collaborative filter or combinations of multiple collaborativefiltering models to produce its outputs. In still other embodiments ofthe invention, the product recommendation engine utilizes combinationsof neural networks and collaborative filtering to process the systeminputs.

Data Processing: Collaborative Filtering

Any collaborative filter has at least three main elements comprisingdata representation, neighborhood formation function, and recommendationgeneration functions. Each will be discussed separately, beginning withdata representation.

Certain inputs and outputs are numerically represented for use by theproduct recommendation engine. As discussed above, products address theneeds of consumers and in general have a range of types of effects.Consumers communicate concerns in a product area in terms of theseverity of their needs (or sensitivity to adverse effects) and howimportant they consider these concerns to the product purchase decision.Depending on the target substrate, a plurality of concerns may berelevant. In certain embodiments of the invention concerns are presentedfor the consumer to choose from. This simplifies the dimensionality ofthe consumer's interactions with the invention to just those concernsthey have chosen to address.

Exemplary concerns, where the category is cleansers and the targetsubstrate is skin, might include cleaning dirt, cleaning grease, killingbacteria, irritating skin, drying skin, imparting a tightening feeling,leaving skin feeling soft, lathers easily, economical, smellingpleasant, and the like. In general, there are i concerns in a givencategory. While the target of the category may be the only substrateconsidered in concerns, multiple substrates could be involved. Forexample, in this category the main substrate is skin, but how theproduct leaves a film on the tub addresses a secondary substrate.Associated with each of the i concerns is an importance level. A newconsumer (or an existing consumer wishing to revise his or her personaldata) interacting with the invention typically identifies concerns,levels for each of the concerns, and how important each concern is inthe product selection decision. A new consumer may also be asked toidentify sensitivity to adverse product effects. An aided scale, wheresome input values are described by words and/or pictures, may beutilized in the data collection process. Other input devices such asslides or dials or image synthesis and the like are envisioned.

A user's Concerns are represented by a N×2 matrix, _(u)C_(ik), where: uis an index representing the consumer (which may be dropped forconvenience in the following); N is the number of Concerns recognized bythe invention; i=1,N; k=1,2; C_(i1)=Severity of i^(th) Concern,0<=_(u)C_(i1)<=10; C_(i2)=Importance of i^(th) Concern,0<=_(u)C_(i2)<=10. Each concern Ci is typically known to the user by adescriptive text name (e.g., wrinkles, dryness, pimples, and the like).A 0 to 10 scale used for each element of the concern matrix is, ofcourse, arbitrary.

Although concern severities and importances are generally subjectiveassessments, in the case of certain concern areas (e.g., where thequality of subjective information is notorious) the subjectiveassessments may be augmented and/or supplanted with objective data. Incertain embodiments of the invention scaled objective data (e.g., ameasured variable) may stand in for a concern or a concern input may berestricted or modified by virtue of the objective data. For example,where skin is the target substrate, skin roughness, photo damage index,and/or elasticity (turgor) may be relevant to scaling certain problemseverities provided by a consumer. The objective data and/or scaledvalues may be used to extend the range of concerns, to add a new concernto the category target concerns, or modify existing concern severityvalues (e.g., by using a linear combination of the subjective andmeasured values related to a specific concern). For example, a consumermay assess wrinkling severity and the invention may weight theconsumer's subjective assessment by a machine value for total wrinklelength. Data from within a consumer's personal profile such as age ortime outdoors may also provide relevant information and be used toadjust concern parameters.

Numerical representations of each measured parameter are chosen so as toreflect the method of measurement in a convenient fashion. Each severityscore, C_(i1), is a real number in a predefined range, for example,between 0 and 10. The computation that relates measurements or relevantsigns or other material properties to is structured so that the mostsevere case of concern C_(i) is given the highest score (e.g., 10),while the lowest score (e.g., 0) corresponds to a lack of any reportedor observable signs or physical indications for the concern.

The importance of concern C_(i), called C_(i2), is represented as aninteger in a finite range, such as the range 0-10, and the like. Notethat in preferred embodiments of the invention importance values are notnormalized because relevant information is often contained in theirabsolute magnitudes and should be preserved.

Turning to representation of preference data, as consumers use productsthey provide preference feedback on those products. In addition, newconsumers may provide preference values for products they have used inthe past, for example in their initial interaction with or early in theprocess of starting to use the invention. As discussed above, preferenceis a measure of how much the product is liked. A variety of aided scalesmay be provided. Table 1 shows an exemplary aided preference scale.

TABLE 1 1 2 3 4 5 6 7 8 9 10 very worse average better best inferiorthan most than most

All aspects of a product typically impact a given consumer's preferencefor that product, including how well the consumer thinks the productworks. In other words, preference values may be influenced by theaesthetics of a product, the perceived performance, and/or marketinginformation. Consumers may also be influenced by system participation,potential invention outputs such as the recommendation of a product onthe basis of predicted preference, predicted performance, and/orperformance tracking information provided to consumers. For this reason,in preferred embodiments of the invention once a new consumer hasevaluated five or six products recommended by the invention his or herinitial or pre-invention use preference values are eliminated from thatconsumer's preference pattern data.

A consumer's preference score for a given product, _(up)PREF, (u=userindex, p=product index) is represented in the system as an integer in afinite range, such as the range 0-10, or 0-100, and the like. Aconsumer's preference score for a given product also should correspondto the rank-ordered set of preference descriptors.

Where the basis for collaborative filtering is finding a neighborhood ofsimilar product preference patterns, it is the pattern of preferencesacross a range of overlapping products used by consumers that determinessimilarity among consumers. To improve predictions of productpreference, certain embodiments of the invention apply preference basedcollaborative filters after concern based collaborative filters areapplied to subset the population to those with similar target problems.

Representation of target or substrate conditions is now considered.Performance predictions and feedback are derived from data that tracksindividual conditions of the target substrate for a given category. Inpreferred embodiments of the invention each condition is an objectiveindex of the current properties of the target substrate that relate toeach of the concern areas. Condition values are ideally calculated froma set of primary measurement variables. However, in some cases conditionvalues may be based on a combination of one or more of subjectivefeedback on current severity of concern of the category (e.g., itchwhere the target substrate is skin), subjective feedback on a set ofquestions about specific assessable attributes of the target substrate(e.g., number of cracks on the hands, the minutes of skin feeling tight,and the like where the target substrate is skin), and objectivediagnostic measurements. For each of the i concerns, data processingproduces a current condition i. Condition, may be any model of the dataobtained that reflects concern_(i). Whether the model correlateslinearly with perceived severity is not necessarily relevant. Toillustrate the concept further, consider tires as a product category.Concerns related to tread wear could be mileage or remaining tread.Measurements of tread depth and odometer miles could be converted toconditions of the tire related to the concerns as follows: tire mileagecondition=(change of odometer miles)*(original tire tread depth)/(changeof tread depth); remaining tread (in miles)=mileage*(remaining treaddepth-minimum safe tread depth)/(original tread depth). Conditionscharacterize the state of the target in a way that directly relates tothe consumer's concerns.

When characterizing performance of a product with preferred embodimentsof the invention, all conditions data obtained while a consumer is usinga product is stored until the use of the product is completed and theperformance feedback of the consumer for the product is decided. Theinitial and final values of the conditions data are stored as a part ofthe consumer databases in preferred embodiments of the invention aswell.

Representation of performance, overall performance, and performancepattern data within the invention are now considered. As discussedabove, conditions are characterizations of a target or substrate at apoint in time. Since starting use of the product, the change or rate ofchange of Condition_(i) are possible measures of performance. Theprecise scale used to numerically represent such data often depends onthe characteristics of the particular data being considered. Inpreferred embodiments of the invention however, a positive or negative0-10 performance scale is employed. In certain embodiments of theinvention a predetermined value of change is assigned to particularvalues on the performance scale. For example, where a 0-10 performancescale is utilized a predetermined value of change may be assigned to thevalues 0, −5, −10, 5, and 10 on the performance scale.

The change of condition is the difference in the value of conditionaveraged over readings obtained in some fixed time intervals. Exemplaryintervals may be the two weeks preceding start of product use and 8 to12 weeks after start of product use. The precise intervals for samplingand initial product effects assessment selected however will necessarilydepend on the product category and associated target. In preferredembodiments of the invention the change of condition value is thedifference between the value of condition averaged over a sampling timeinterval beginning some defined time period after start of use less aninitial condition (which may or may not be averaged over some initialtime interval, perhaps during the week preceding start of product use).Rate of change of condition could be the fit slope of the condition oversome defined time interval, for example the first two months of productuse. The target substrate's change kinetics, typical product effectkinetics, and the specific condition are factors that may be consideredin deciding how condition changes are translated to a useful performancescore.

Once appropriate time intervals are selected, an appropriate translationfunction is selected to arrive at a performance score. Translationfunctions may comprise any number of functions including, by way ofexample only, linear translation by formula, nonlinear translation byformula, and/or a lookup table. The process of selecting a translationfunction may begin by looking at the distribution of condition changesacross all products and a large number of consumers so that thedistribution of changes may be translated to performance scores. Anexemplary translation may have the top 10% of changes correspond to a 10on a performance scale of 0-10 while average results correlate to a 5. Atool helpful in performing the foregoing is a two dimensional map ofdistribution of condition changes as a function of initial condition. Amodel of performance score based on amount of change and initial levelof a condition is often preferred.

Performance of a product for a given consumer preferably is computed foreach concern Ci using the observed change of the condition and the levelof the consumer's initial concern, _(up)PERF_(i), (where ‘u’ and ‘p’ areindices referencing the consumer and product respectively and i is thecondition index). The overall performance score for the product,_(up)PERF, typically is computed as the importance weighted sum of theeach concern Ci using the observed change of the condition and the levelof the consumer's initial concern, _(up)PERF_(i), (where ‘u’ and ‘p’ areindices referencing the consumer and product respectively and i is thecondition index), normalized by the sum of importances.

In the case of biological target substrates, measurable or assessablesigns are an alternate terminology for certain properties of the targetsubstrate. In this case change in condition is determined by change inthe signs. Optionally, performance metrics at the level of the signs canbe utilized with the invention.

For a particular consumer, an overall performance prediction may bepresented as part of the product recommendations output. Overallperformance prediction may characterize the “predicted performance” of atop-N performance recommendation listing output, and also may bereported in other formats of recommendation outputs. Overall performancepredictions use the predicted performance for each concern derived fromthe observed performances seen by consumers similar to the consumer(such as those in the consumer's collaborative neighborhood, in certainembodiments of the invention). The overall performance prediction is theconsumer's concern importances (C_(i2)) weighted average of the productperformance predictions (normalized by the sum of the importances.)

In certain embodiments of the invention, a performance response patterncomprises a rank ordering of product performance results in a singleconcern area or overall for all the products the consumer has used andprovided feedback to the invention. This rank order allows grouping ofclients with similar response patterns versus different responsepatterns. In certain embodiments of the invention separation of thepopulation of consumers into different response pattern classes isperformed when doing so reduces the standard deviation of performancefor that concern for the subpopulations versus the entire population. Ifperformance response pattern is a valid predictor of performance,consumers may be clustered or a secondary collaborative neighborhood maybe defined on the basis of performance response pattern for the set ofrelevant products. This is done to separate targets with common responsemechanics from targets having alternative response mechanics.

Personal profile information may be represented numerically also. Asdiscussed above, personal profile information may be relevant to thecondition and concerns of a target substrate in a particular productcategory. A consumer personal information vector, _(u)PI, may beconstructed whose components correspond to the personal profile data ina fashion that will enable _(u)PI to be used in computing or filtering asimilarity group (also referred to herein as a collaborativeneighborhood).

Psychographic or personality markers may also be assessed andrepresented numerically as they are often determinants in productpurchase decisions and may manifest effects on product preferences.Psychographic markers are more likely to be advantageous in embodimentsof the invention employing neural network analysis than collaborativefiltering.

The second main element in collaborative filtering is neighborhoodformation. Techniques for defining a subgroup of consumers that aresimilar to a given consumer are now defined. Any set of data that willbe used to establish consumer neighborhoods comprises a space that is amultidimensional representation of the consumer population. In analogyto the distance between two points in ordinary space, a generalizeddistance between any two consumers (consumer j and consumer k) in therelevant space is defined as:

d _(jk)=√{square root over ( )}(Σ_(i) a _(i) ²(ΔP _(ijk))²)/√{squareroot over ( )}(Σ_(i) a _(i) ²)  (Eqn. 1)

where ΔP_(ijk) is the difference in consumer j and k's values of the ithparameter used in the consumer space, and a_(i) is a coefficient thatscales the various parameters. In preferred embodiments of the inventionthe distance is normalized. Normalizing stabilizes the distances asdifferent parameters are considered as part of the consumer space andcoefficients are scaled, stretching the space in various ways to testfor narrower prediction distributions in spherical neighborhoods (allconsumers within a fixed distance from a particular consumer). Thiscriteria is equivalent to improving the precision of predictions. Thesmaller the distance used to limit the size of the neighborhood thetighter the prediction distribution. On the other hand, the smaller thedistance the fewer values there are for a given product, thereby runningthe risk of hurting accuracy. The coefficients a, should be chosen sothat all dimensions (adjusted parameters) have similar effects on thespread in prediction distributions.

Ideally, “similar” means consumers that have similar preference andperformance outcomes to product usage. In some embodiments of theinvention the definition can be directly implemented so that theparameters P in Eqn. 1 include the performance and preference scores forproducts and the distance is based in part on the similarity of theseparameters wherever there is usage data for a common product. In thisscheme, the distance between any two consumers involves a differentnumber of dimensions. The normalization denominator in Eqn. 1 canaccount for this. However, the number of shared products should berecorded and when there are not adequate overlap in product use toestablish a confident determination of similarity, the other consumershould be excluded from a given consumer's neighborhood. It isbeneficial to allow more consumers in the collaborative neighborhood sothat more product recommendations can be made with greater confidence.For this reason, a preferred embodiment of the invention uses similarityin concerns and other consumer characterizations to establish a sizable,relevant neighborhood or recommenders.

In this model, all consumers are available for membership inneighborhoods because usage of products in common is not required. Theparameters used to position each consumer in a space are formed fromcombining any or all of concern severities, concern importances, targetconditions, personal profile information, and aesthetic choices.Dimensions of the space may also be constructed from various ratios orproducts of these consumer characterizations. The similarity group for agiven consumer user is then defined as the set of other consumers withina limiting distance from the consumer being served in this spaceaccording to Eqn. 1. The limiting distance may be adapted for eachconsumer and product being considered for predictions of performance andpreference, so that a statistically appropriate number of “similar”product users are captured. For example, as the number of system usersgrows, the threshold could be reduced while maintaining the same averagenumber of similar consumers. When a preference or performance basedsimilarity dimension can be constructed this can be combined with theconsumer characterization based space described herein.

Aesthetic choices, discussed above, are a subset of personal profileinformation concerned with preferences for specific forms of productwithin a category. Preference patterns often are strongly influenced byone or more aesthetic choices. Thus, in certain embodiments of theinvention a consumer's predicted preferences are derived at least inpart from a neighborhood of consumers additionally filtered to have thesame or similar aesthetic choices. For example, where the productcategory is cleanser and the target skin, a consumer who prefers barsoap over a shower gel would not be interested in a shower gelpreference-based recommendation. The invention nonetheless may stillpresent a shower gel in a top-N performance list because a consumer maystill want to know that a high performance predicted product is outthere even if in a less desired form. A neighborhood may be defined sothat it is large enough to generate all of the recommendation values(predicted performances and preferences) that are needed for a sessionwith a particular consumer. In certain embodiments of the invention aneighborhood limiting distance can be a constant for any given consumer.In preferred embodiments of the invention though a limiting distance canbe selected for each consumer based on the density of consumers in theregion of the consumer space where the particular consumer is located.The latter embodiment allows a larger limiting distance to be selectedwhen a consumer is located in a region of the consumer space that issparsely populated. Even more precision in the predictions may beachieved if the limiting distance is adjusted for each consumer and foreach product considered so that every prediction uses the smallestpossible limiting distance. There are computing costs associated withthe foregoing and subtle effects on the precision of comparisons becausea different group of consumers is involved for each product'spredictions. Products without sufficient statistical support (too largea variance or too few instances of use) may be culled.

The consumer space may be constructed in a number of ways, and a singleembodiment of the invention may use one type of space to generateproduct recommendations for certain consumers and other types of spaces(e.g., using different parameters) to generate recommendations for otherconsumers. Commonly, the space for preference predictions will involvedifferent dimensions than the space used for performance predictions.Note though, in each case the space should be filled with every clientin the system. Exemplary though narrowly defined spaces that may beemployed in the invention include, but are not limited to: needs-basedspaces, responsiveness spaces, preference spaces, and the like. In eachcase, the space can involve dimensions that go beyond the titlelimitations. Furthermore, the use of compound spaces which add thecharacteristics of two or more of these simple spaces are within thescope of the invention.

In a needs-based space, concern severities may be the majority ofdimensions. Another space may be formed with the product of importanceand severity data, which may be referred to as a needs gap space. Eachspace may add personal profile dimensions or any other parameters thatimprove the quality of predictions when compared to feedback.

A responsiveness space is based primarily on conditions or changes incondition recorded for standard products or classes of products. Aresponsiveness space might be employed where the target substrate ismedical in nature and it would be helpful to group consumers. Responsepatterns are described above. In the case of medical targets responsepatterns identify consumers on the basis of underlying biologicalmechanisms.

A preference space may be particularly useful for a product categorywhere a relatively large number of products can be sampled and consumerscan provide definitive preference information. Where consumers alsoprovide objective feedback on the specific performance factors, detailedperformance predictions can enhance consumer purchase choices. Anautomobile product category is well-suited for use of a preferencespace. A preference filter may let a consumer who likes certain types ofvehicles, best expressed by the set of vehicles that fit this class, seethat other consumers with similar tastes also like a few models theclient is not familiar with. Real world consumer generated data onaspects of vehicle performance that could aid the consumer in selectingone or more of the recommend vehicles would be provided in certainembodiments of the invention.

The third main element of a collaborative filter comprises therecommendation generation function. Given a consumer and the set ofsimilar consumers (i.e., neighborhood), product recommendations for thegiven user are made. Once the dimensions or coordinates of thecollaborative consumer space are selected and the size of thecollaborative neighborhood defined, preference and/or performance scoresare calculated for every product in the category for the given consumer.The scores may be sorted, and then used to define a top-N list ofpredicted preference products, where N is the number of productrecommendations presented to the consumer.

Overall performance prediction scores often are more complicated thanpreference scores because they are generated from a performance matrix,a one dimensional matrix for each product predicted for each consumer.There is a performance component for each concern topic. For eachproduct in the category, the average performance matrix is calculatedover all consumers within the collaborative neighborhood. Typically,filtering is not done for aesthetic choices. Filtering however may beperformed for other personal profile information factors used in thepreference prediction. In preferred embodiments of the invention overallperformance for a single product for consumer k (OPP_(k)) is theconsumer's importances (I_(i)) weighted average of the elements of theperformance matrix. Or, in equation form:

OPP_(k)=Σ_(i) I _(ik) P _(i)/Σ_(i) I _(ik)  (Eqn. 2)

Overall performance scores may be sorted, and then used to define atop-N list of predicted performance products. In preferred embodimentsof the invention the OPP scores are reported for products in a top-Npreference table as well (when available).

Data Processing: Neural Network Analysis

Certain embodiments of the invention utilize a neural network togenerate its recommended products. The neural network is used to modelthe relationship between various inputs, such as consumercharacterizations and consumer feedback, and various outputs, such asproduct performance and preference predictions. Each consumer typicallyhas a range of one or many needs to be addressed.

The input variables may include client personal profile information,preference and performance values for previously used products, concernmatrices (typically including severities and importances), andconditions which are psychometric models of assessments or measurementsof target attributes that relate to concern areas. As consumers useproducts recommended by the invention, their individual preferences dataand performance matrices for products used accumulates additional data.

As discussed above, given a consumer's set of input parameters, inputsfrom other consumers who have used and provided performance and/orpreference data, and a trained neural network, the productrecommendation engine uses the neural network to generate predictions ofperformance and/or preference for products which have been used by otherconsumers, but not necessarily by this consumer. Product recommendationoutput forms for the given consumer (typically in the form ofperformance and preference predictions contained in custom constructedrecommendation tables) are easily generated from the sorted predictions.

In preferred embodiments of the invention the predicted performancescore comprises an overall performance score derived from a performancearray for each product recommended to a consumer. Typically there is aperformance prediction for each concern identified by the consumer. Foreach product in the category, the performance matrix is output based onthe neural network's model for each performance parameter. The overallperformance prediction (OPP_(k)) for a single product for consumer k iscomputed in the same manner as with a collaborative filter, discussed indetail above. Overall performance scores may be sorted, and then used todefine a top-N list of predicted performance products. In preferredembodiments of the invention the OPP scores are reported for products ina top-N preference table as well (when available).

FIG. 10 illustrates in functional form how the product recommendationengine 1000 operates in an embodiment of the invention that utilizes aneural network and the neural network utilizes product attributes asinputs. Product recommendation engine receives as inputs productattributes 1001 (derived from all the system knowledge about productsused by consumers or, upon startup of the system, priming data) and anindividual consumer's characterizations record or profile 1002. Theprocessing or hidden layers 1003 of operate on the inputs 1001, 1002 toproduce product recommendations outputs 1004.

Data Processing: Hybrids

Where the recommendation engine of the invention utilizes collaborativefiltering as described above, neural network analysis can be used toimprove the function/performance of the product recommendation engine.For instance, and by way of example only, the output (e.g., predictions)from the collaborative group can be processed by a neural network, or aneural network may be used to generate early predictions of whether aproduct is likely to not be beneficial.

As discussed above, filtering of collaborative neighborhoods on thebasis of aesthetic choices and/or other personal profile information maytighten the standard deviation of the distribution of preferencesaveraged within the collaborative neighborhood to provide a consumer amore accurate prediction. After collaborative filtering to a consumer'sneighborhood in client space, a neural network may be trained to selectthose consumers most likely to match the responses of the consumer beingserved. In embodiments of the invention that periodically examine thequality of predictions, the neural network operating on all availableinputs can find better predictive models for each output parameter. Anembodiment of this invention might use collaborative filteringtechniques for performance prediction generations and neural networkmethods to generate preference predictions. In this variant of theinvention, the predicted performance data could be an additional inputfor the neural network generating preference predictions.

Yet another hybrid data processing model that may be employed combinescollaborative and content-based filtering. FIG. 11 illustrates a cascadeof collaborative and content-based filters 1100 utilized in certainembodiments of the invention. Cascade 1100 represents a novel approachto exploiting both social and content information that is particularlywell suited to the present invention. With this cascaded architecture1100, the collaborative filter 1102 is tuned to output predicted ratings1103 for many products based on a current consumer's characterizationprofile 1107 and the knowledge regarding all consumers and productscontained in database 1101. Ratings outputs 1103 then form the input tocontent-based filter 1104, which selects products from those inputs forwhich the product features stored in the product features database 1105match well with the user's aesthetic choices contained in the personalprofile information. The products selected by content-based filter 1104comprise the final recommendations 1106 output by the productrecommendation engine.

Data Processing: Database Priming

New products may be introduced into the system in a variety of ways.Consumers may enter feedback data for a product that is not yet in thesystem by entering appropriate product identity information. Though thesystem will not generate recommendations for the product until adequatefeedback is available, it will continue to accept feedback from users.The system may utilize methods to enable faster recommendations of a newproduct which we refer to as priming. The product database may be primedwith synthetic and/or actual historical inputs and feedback. In systemsusing product attributes, that is, performance data representing themean performance for each consumer segment, the priming data mayincorporate product attributes assigned by experts in the field. Thepriming data would be diluted out rapidly by actual feedback of the newproduct. Alternatively, performance and/or preference data on a newproduct could be obtained from recruited sets of well characterizedusers, or the like. Over time, as consumers use the new product, currentdata is assembled and priming product attributes and/or productperformance and preference data are adjusted or diluted in conformancewith the assembled data. When enough records of system based use of aproduct are accumulated, the priming data may be eliminated as it islikely inferior to the system-based data. Re-training is discussed inmore detail below.

Re-Training and Feedback

Re-training of the product recommendation or forward intelligence enginewill now be considered. Certain embodiments of the invention improvetheir recommendation quality over time by periodically re-training theproduct recommendation engine based on consumer feedback. In particular,preferred embodiments of the invention utilize preference andperformance ratings received from consumers after using products toperiodically assess the precision and/or accuracy of productrecommendations generated by the invention. The data processingalgorithms of the invention are re-trained to reduce the differencesbetween actual feedback and earlier predictions. As the density of dataincreases the optimal weighting functions and spatial structure maychange. In this way, the outputs of preferred embodiments of theinvention continually improve as the population of performance andpreference feedback data grows. Accordingly, another form of ancillarydata output by certain embodiments of the invention may compriserecommended feedback intervals.

Accuracy is some measure of the agreement of each consumer's predictedperformance and/or preference values with feedback regarding theseparameters from consumers after using the products. Improving agreementamounts to minimizing the sum of the differences (prediction lessfeedback), or minimizing the sum of differences squared, and the like.Adjustments may include changing the spatial dimensions or their scalarweightings in a collaborative filtering space, filtering neighborhoodsby additional personal profile information variables, re-training aneural network, applying better neural network models to the predictionsfrom collaborative filtering models, and the like.

FIG. 12 shows in functional form how feedback is utilized in certainembodiments 1200 of the invention. Block 1201 represents productattribute data gathered by the system of the invention 1200 (or in thecase of initial system startup, entered as priming data). Block 1202represents consumer needs data, objective and/or subjective feedback(such as diagnostic data), personal profile information, and the likesolicited or gathered by the system from consumers using system 1200.Arrow 1203 represents the operation of the system's productrecommendation engine (also referred to herein as the forwardintelligence engine) on the system inputs (i.e., blocks 1201 and 1202information). Block 1204 represents the product recommendationsgenerated by the product recommendation engine in arrow 1203 and output1209 to consumer users of system 1200. Block 1205 represents theselection, purchase, and use of a product to treat a concern byconsumers. Note, as a general matter the product selected and used bythe consumers need not be one of the products recommended by the system1200, or even presently within the knowledge base of the system 1200.Consumers may select and use any product they choose to treat a concernfor which they have identified to the system 1200 (e.g., block 1202) andprovide feedback about that product (e.g., 1208, 1212, 1216). Block 1208represents feedback (e.g., new diagnostic measurements and subjectiveresponses) received by the system 1200 from the consumers andincorporated 1212 within the knowledge base of system 1200. Arrows 1215and 1214, together with block 1213, represent the re-training (sometimesreferred to herein as a reverse intelligence engine) of the system's1200 product recommendation engine (product recommendations 1204 arecompared to actual consumer feedback 1208 in order to adjust productattributes 1201).

Feedback, whether objective and/or subjective in nature, regardingperformance with respect to a range of products may be used to defineindividual consumer performance response profiles. When there arepotentially a variety of underlying mechanisms contributing to aconsumer's concerns, his or her performance response profile pattern mayhelp the recommendation engine align his or her target substrates withother consumers who have common underlying problem mechanisms. Differentunderlying problems may be addressed differently by various products.For example, acne has several causes (microbial, desquamatory,inflammatory, and the like) that typical consumers could not distinguishusing their senses alone, but which may be distinguished with the aid ofdiagnostic device measurements and/or by detecting the pattern ofperformance responses to different classes of products and actives.

Where the systems employ a neural network consumer feedback is used toenlarge and update the training set. The new feedback providesadditional training examples used to reconstruct the neural network. Forinstance, consumer feedback may be used to adjust connection weights ofthe algorithms in the invisible layers of the neural network. In someimplementation of a neural network, the updated training set is thenused to adjust product attribute ratings for each consumer segmentemployed in some embodiments of the invention. As the number of consumerresponses gathered by the invention increases, the accuracy andstability of the product attributes improves. In this re-training modeof operation, termed the “reverse intelligence engine” as shown in FIG.12, the neural network uses consumer responses and outputs of theinvention's forward intelligence or product recommendation engine asinputs and optimizes product attributes to improve recommendationaccuracy in an iterative process. Objectives of this re-training arenumerous and include improving the accuracy of future recommendations,generating insights on product performance for the purpose of productdevelopment, and the like. The invention may also improve the accuracyof predictions for each consumer as it learns more about the consumer'ssubjective and/or objective responses to products.

Part of the learning function referred to above may include periodicallydetermining whether the feedback supports any bases for groupingconsumers in a way that narrows the standard deviation of preferenceand/or performance distributions within any client neighborhood. If suchbases are found they are incorporated into the algorithms of the productrecommendation engine and used to subset appropriate neighborhoods whengenerating predicted performance and/or preference ratings and the like.It is important to note that while knowledge of a product's effect ismade more accurate as the standard error of the mean is reduced,predicting an individual's response depends on the width of thedistribution of effects measured over the population of similar users.It is assumed the distribution reflects primarily true variety ofresponse and not measurement accuracy. The standard deviation needs tobe as narrow as possible to increase prediction accuracy. Therefore,reducing the limiting distance of a collaborative set involves atradeoff between reducing the standard deviation of the prediction (toimprove precision) and increasing the standard error of the estimate(reducing accuracy) because the number of consumers contributing sampleinformation is smaller.

Professional Integration

Professional integration refers to use of the invention by professionalservice providers. Typically professional integration involves theconstruction of a professional interface, which may comprise a series ofsoftware and/or specialized diagnostic tools that allow professionalsaccess to consumer data and characterizations (individual and/orpopulations). Professional integration also refers to methods ofreferring a consumer served by the invention to a professional serviceprovider (such as a physician in the case of medical targets) whenconditions outside of the normal range of values are detected by theinvention or when the system has objective or subjective feedback dataindicating a professional service rates highly to address the concernsof a consumer. As data on professional assessments of needs, causesthereof, prescribed treatments, and/or feedback from professionallyrecommended products is acquired, the invention's product recommendationengine may be re-trained and the invention itself may aid professionalsin their needs assessments, treatment recommendations, and the like. Inparticular, where medical targets are involved the data analysisperformed by certain embodiments of the invention may detect patterns ofresponses that may be instrumental in predicting best therapeuticoptions to use to treat disease conditions and the like. The conversemay be true as well.

Embodiments of the invention may be implemented wherein productrecommendations (e.g., predicted performance, predicted preference, andthe like) and/or ancillary information for specific products andservices obtained from a professional (e.g., prescription drugs and thelike) are reported to the professionals but not directly to theconsumers. FIG. 13 illustrates in functional form how some professionalonly embodiments 1300 of the invention may operate. Block 1301represents a database wherein product and consumer informationcomprising at least a portion of the invention's knowledge base. Block1302 represents the data processing portion of a product recommendationengine that operates on data drawn from database 1301 and a request froman individual consumer and/or a professional servicing that consumer togenerate product recommendations 1303. Block 1304 represents aprofessional service provider who is the only person to receive theproduct recommendations 1303 generated by system 1300. Professional 1304conveys that information he or she deems appropriate to the individualconsumer/client 1306. Professional 1304 provides feedback about theindividual consumer/client 1306 to system 1300 him or herself via aprofessional interface 1305. Consumer/client 1306 provides objectivefeedback 1307 such as diagnostic data to system 1300 as well.

Another embodiment of the invention comprises an implementation whereina consumer authorizes a professional service provider access to his orher data. FIG. 14 illustrates in functional form how one such embodiment1400 of the invention operates. With permission from the consumer/client1304 his or her professional service provider 1402 (e.g., a physicianwhere a medical target is involved) accesses the invention viaprofessional interface 1404 to view consumer progress on historical,current, and/or proposed treatments, client characterization displays,product recommendations (“recos”) for the consumer, and the like 1402.

Yet another embodiment of the invention may be implemented wherein bothconsumers and professionals may access data within and recommendationsgenerated by the invention. In these embodiments, direct consumer accessto the invention might be limited to viewing progress indicators (ifprovided), understanding their condition, and the like. Potential basesfor implementing such an embodiment include, by way of example only,when diagnostic assessments of treatment performance can only beperformed by a professional, when most treatments require professionaladministration, and the like. In the case of a medical target forexample, acne patients could be characterized by the invention as tolesion type, distribution, stage, and patient condition and historyparameters. In this case the invention would predict performance ofalternative treatments based on continuous training of the predictivefunction. Input and access would be primarily available to physicians.

FIG. 15 depicts in functional form how one such embodiment 1500 of theinvention operates. Block 1501 represents a database wherein product andconsumer information (gathered from both consumers and professionalservice providers) comprising at least a portion of the invention'sknowledge base is stored. Block 1502 represents the data processingportion of a product recommendation engine that operates on data drawnfrom database 1501 and a request from an individual consumer and/or aprofessional servicing that consumer/client to generate output 1503(e.g., product recommendations and/or ancillary information). Block 1504represents a professional service provider and block 1506 represents theconsumer/client for whom outputs 1503 were generated. The outputs 1503are available to both consumer/client 1506 and professional 1504.Alternatively, all outputs (“p+c” for professional and consumer/clientoutputs) are available to the professional 1504 while a more limitednumber of the outputs (“c” for client outputs) are available toconsumer/client 1506. Consumer/client 1506 provides feedback 1507 (e.g.,diagnostic data, preference data, and the like) to system 1300 viaprofessional interface 1505. Alternatively, professional 1304 providesfeedback (not shown) about the individual consumer/client 1506 to system1300 him or herself via the professional interface 1505 as well.

Where a professional is knowledgeable about an implementation of theinvention, he or she may have a client begin using the invention as aconsumer. Because professionals often have access to diagnosticcharacterizations (whether specialized or not), they often will be ableto obtain and input into the invention a solid baseline assessment ofthe new consumer (i.e., new client or new user). Thereafter, dependingon the implementation of the invention, the professional may be able tomonitor the progress of the client/consumer via the invention. Forinstance, where the invention includes imaging capabilities adermatology professional may enroll a patient and use the invention totrack patient progress over time by monitoring changes in stored images.The invention may also allow the professional to annotate images withcomments, indicate on the images important features or regions, and thelike. Using feature analysis and intelligent processing, someembodiments of the invention may automatically register and align imagescollected at different times and quantify changes. The source of theimages may be the professional, the consumer, other sources, or somecombination thereof. Thus, such an implementation of the invention canbe used in conjunction with visits by or to a professional as a way ofincreasing the frequency of monitoring. The professional could reviewclient/consumer data from the invention (e.g., substrate images) at aconvenient time and then contact the client/consumer to discuss the dataand/or request that the patient/consumer and professional schedule ameeting.

Certain embodiments of the invention may collect and store data (e.g.,images, physical characterizations, and the like) on clients/consumersassessed by professionals as to underlying conditions and/or causes.These embodiments may utilize any number of predetermined criteria fordiagnostic accuracy (e.g., in the case of medical targets percentage ofmissed diagnoses when disease is present, percentage of wrong diagnosiswhen disease is diagnosed, and the like) to re-train invention's productrecommendation engine (e.g., collaborative filters, neural networks, andthe like). In this way the invention may aid the professional in earlierassessment of needs, causes, conditions, treatments, and the like thanotherwise would be possible. Conversely, in another embodiment theinvention may detect a need/condition that warrants professionaltreatment and advise the consumer to seek the same. For example, theinvention could be programmed to monitor for potentially adverseconditions known to be associated with a particular product, and wheredetected, advise the consumer to contact the appropriate professional.Where medical targets are involved the invention also could compile andforward such information to an appropriate regulatory authority such asthe Federal Food and Drug Administration (FDA).

Various embodiments of the invention may allow consumers and/orprofessionals to access ancillary output such as textual content relatedto specific conditions, treatments, and the like within a relevantproduct category (e.g., skin care). Professional content, largelyscientific literature, may be segregated from nonprofessional content.Content searching tools may be provided as well.

Preferred embodiments of the invention involving certain forms ofprofessional integration have some means of identifying whether aproduct is being used as part of a professional service. In theseembodiments data on patients (versus consumers) will not contribute tothe nonprofessional understanding of the effectiveness ofnonprofessional products (e.g., non-prescription drugs in the case ofmedical targets). Two issues form the bases for this division of data, areporting issue and a differential placebo effect issue. The firstinvolves who provides the data input to the invention. Data for consumersystems is self-reported and self-rated. Data for professional systemsis evaluated and reported by a professional and therefore likely to bemore quantitative and more objective than consumer reported and rateddata. With regard to the second issue, product efficacy may be affectedby the attitudes of the user. Professional treatment may change thebehavior of a client in a way that materially effects target substratecondition. Differential placebo effects operate in almost every clinicalstudy environment. One can therefore expect similar phenomenon operatingin a professional environment, particularly where medical targets andproducts are involved.

Certain embodiments of the invention can assist in data collection forclinical trials of new products. Typical clinical trials involve avehicle or placebo and an active product that are tested among twopopulations of subjects. The subjects are randomly assigned to theactive product or the placebo. The invention ensures all subjects meetthe entrance requirements and any image data is graded blind to site ortime point. The efficacy results of the active product can be comparedto other available treatments and indications identified for consumersresponding best to the new treatment (i.e., active product). Theinvention can also be used to compare the results of clinical trialswith actual use of the new product by consumers outside the clinicalparadigm.

Another use of the invention relates to the training of professionals.In the case of medical professionals such as dermatologists, the currentmethod of training typically involves viewing individual patients and isrestricted to small, random sample sizes. The database portion of theinvention will contain a large amount of real-world data regardingtarget substrates and their response to various treatments over time.For example, in certain embodiments of the invention the database willhave many images of normal and diseased skin, as well as data related toaging, the effects of sun and environmental exposure, and the effects ofvarious skin-care products. The database also would contain data ontreatments and how those images change as a function of the treatmentsover time. This data could be of great value in training professionals.

Methodologies

FIGS. 16 and 17 depict in functional and flow diagram form respectivelya typical interaction of a consumer with certain embodiments of theinvention. The process depicted in FIG. 16 mirrors for the most partthat depicted in FIG. 17. As shown in FIG. 17A, process 1700 starts atstep 1701 and, in step 1705, the invention receives a request from aconsumer for product recommendations. In step 1710, the inventionsolicits input from the consumer, which is received at step 1715. Asdiscussed above, input may comprise a wide variety of informationincluding personal profile information, concern areas, severity andimportance for each concern area, preferences for products usedrecently, and the like. In step 1720 the invention creates a consumerprofile in its consumer database or other storage, and then generatesproduct recommendations with its recommendation engine. In step 1725,the invention presents its recommendations to the consumer. Note also,the invention may present and/or the consumer may request and receiveancillary information output at this point in the process as well. Instep 1730, the invention receives notification of the products) selectedby the consumer for use. In step 1735, the invention presents theconsumer with a recommended feedback interval. In step 1740 (FIG. 17B),the invention waits for feedback to be received from the consumer.

In step 1745, the invention receives a request from the consumer toprovide feedback on the products) previously selected and subsequentlyused. In step 1750, the invention receives feedback data from theconsumer. As discussed above, feedback may comprise subjective and/orobjective data regarding actual performance and preference for theproduct(s) used by the consumer. In step 1755, the invention updates theconsumer's profile, and in step 1760 the invention generates anddelivers to the consumer progress indicators. In step 1765, theinvention queries the consumer whether he or she will continue using theproduct(s). If yes, the process returns to step 1740 and waits for morefeedback from the consumer. If no, the process in step 1770 queries theconsumer whether he or she would like to select a new or differentproduct to use. If yes, the process returns to step 1720. If no, theprocess ends in step 1775.

FIG. 18 illustrates in flow diagram form a process 1800 for re-trainingthe recommendation engine in accordance with certain embodiments of theinvention. The process starts in step 1801 and, in step 1805, theinvention receives individual input, creates individual profiles, andgenerates individualized product recommendations for a relevantpopulation of consumers. In step 1810, the invention is informed ofwhich products the individual consumers select for use. In step 1815,the invention receives feedback from the individual consumers regardingtheir use of the previously selected products. In step 1820, theinvention determines whether the feedback received in step 1815 warrantsre-training of the product recommendation engine. If yes, the inventionin step 1830 re-trains the product recommendation engine based on thefeedback received in step 1815 and then returns to wait step 1825. Ifno, the invention in step 1825 waits for some predetermined amount oftime, some predetermined number of feedback interactions, a manualcommand, or the like before returning to step 1820.

FIG. 19 illustrates some of the concepts and potential revenue streamsthat may be realized with various embodiments of the invention. Theinvention can be a component of a product distribution system. Operatingas a service provided over the Internet (or through the mail or by phoneorder), the invention facilitates transactions based on the consumer'seducated selection process. The invention collects and createspreviously unavailable high quality product performance and preferenceinformation, thereby creating novel revenue streams at multiple pointswithin systems incorporating the invention. FIG. 19 identifies a numberof these points with dollar signs (“$”). Also, whether incorporatedwithin a wider a system or not, the knowledge accumulated and created bythe invention has value to various shareholder groups including, but notlimited to, consumers and third-party entities such as professional andnonprofessional service providers (e.g., medical and non-medicalprofessionals), distribution chain entities (e.g., retail stores,wholesalers, and the like), product developers, marketing personnel,market analysts, and the like. Knowledge comprises any informationgathered by, created by, contained or stored within the various elementsof the invention.

Two revenue streams generated by the invention present themselves in theform of product recommendation fees 1902 and consumer subscriptions1901. In the case of product recommendation fees 1902 a consumer pays afee in exchange for receiving the product recommendations. In the caseof subscriptions 1901, consumers pay a fee in exchange for ongoingaccess to invention recommendation services because of, among otherthings, the unique historical data the invention stores regarding theindividual history of each subscriber. The history may include anynumber of items including, but not limited to, the physical andsubjective responses of the consumer and/or their target substrate toparticular products, weather, other relevant conditions, and the like.Over time, the invention obtains expertise in predicting each consumer'sfuture responses by better characterization of the consumer-subscriberand more accurate alignment of the consumer-subscriber with otherrelevant segments of the population.

In some embodiments, a consumer can pay additional fees for premiumservices. For example, a consumer subscribing to the standard level ofservice may interact with the invention via a menu. A consumersubscribing to premium services may interact with the invention via amenu and/or a live person. Yet another level of service may involveinteracting via a simulated persona.

In other embodiments of the invention, a consumer may choose from aplurality of rate plans where each rate specifies a plurality of factorssuch as, interaction method (home, spa, computer, and the like), minutesof interaction time, storage space (images, history, and the like),minutes of professional time, and the like. Standard level of servicecould provide top-N products by performance or preference. A highersubscription level would provide information on any number or productsas well as arbitrarily named products. Another basis for differentiatingsubscription levels is on the diagnostic variables tracked for thesubscriber. Basic level could involve no physical parameters, higherlevels could include a few parameters, and the highest levels imagebased parameters. Service levels could be defined by the consumer'sselection from a series of choices including but not limited tofrequency of access, number of products rated, number of images storedper year, particular parameters chosen for monitoring, and the like.

Another revenue stream generated by the invention presents itself in theform of kiosks and other remote site access 1903. Kiosks (providingaccess to recommendations, ancillary information output, category wideproduct information, and the like) provide a way for consumers to accessthe invention at the site of product sales or without having personalInternet access. Ideal sites include wherever products are sold or nearexpert assistance. The services offered by kiosk may be at anintroductory level and free to new consumers. Existing subscribers couldaccess all information including those that incur charges to theiraccount. Pre-paid cards could be sold or credit cards accepted forservices as well.

The kiosk-based system may ask for consumer login information, or fornew users, login information would be provided to permit easier futureuse. Log in could be biometric based. For new consumers a few questionsmight be presented to understand the general needs of the consumer. Theinvention might provide top-N recommended products filtered byavailability at that store or for all stores at the location of thekiosk. The consumer also may be able to see recommended productsavailable through mail order (unfiltered). In either display the outputshould be standardized (e.g., performance and preference sores andprice.) For products not available at the location of the kiosk theconsumer may have the option of selecting mail order. Various revenueexchanges are possible with this service. Consumers also could receivecoupons to shop at the location. The operator of the invention mayreceive a commission when a kiosk-issued coupon is used locally. Kioskscould be placed in locations such as train stations, airports, malls,department stores, resorts, gyms, health spas, hair salons, any locationwhere consumers wait to receive services, and the like.

Because certain implementations of the invention may be international inscope, the knowledge accumulated by the invention likely includesinformation on brands and/or categories of products not currentlyavailable in all areas of the world. The knowledge accumulated by theinvention therefore can be used to facilitate identification of newbrands, products, and/or ingredients that may prove successful in newmarkets. Information on the efficacy of products covered by animplementation of the invention can be made available for a fee and/orthe most effective products in various categories could be madeavailable in a static database of recommended products. Implementationsof the invention also could integrate distribution facilities and/orfunctions for both domestic and foreign products.

Another potential revenue stream that may be realized presents itself inthe foul' of data mining 1904. The invention's knowledge can be minedfor intelligence of value to industrial components with interest in aparticular product category. Data mined from the invention orintelligence may include, by way of example only, product performanceand/or preferences among any segment of a market, objective performanceand/or perceived performance for every category concern for any product,comparative performance between products, and the like. Additional datathat can be mined from invention databases that could be valuable toindustry includes, which consumers use and prefer which products, brandswitching and loyalty data, product interactions and regimen effects;trends in population demographics and needs, and the like. Mined data orintelligence could be sold to entities formulating new products,entities wishing to document, test and/or validate new claims forproducts, or entities seeking competitive evaluation of products.

Another revenue stream that may be realized involves brokering services1904. Products used by consumers may be identified by the invention thatmeet the criteria of companies interested in acquiring new products ortechnology in the target category. The operator of the invention cancharge a fee for identifying products meeting the criteria of anacquirer. This method of identifying suitable products likely is betterthan simply monitoring purchases of new products because data from theinvention may be available sooner and allow for easier separation ofperformance from preference and marketing factors.

Another revenue stream that may be realized involves payment of acommission for products purchased and/or consumers referred 1905. When aconsumer orders a product directly from the operator of the inventionfor example (in embodiments where this type of purchase is an option),the product may be supplied by mail from an allied distribution company.The allied distribution company pays a commission on the sale to theoperator of the invention in exchange. Coupon sales provide anotherexample. Where a consumer wishes to purchase a recommended productthrough conventional shopping outlets, a link between the recommendationand purchase of the product may be created by issuing a coupon orvoucher to the consumer. Manufacturers and/or retail outlets would offerthe coupon as an incentive to select a particular recommended productand/or purchase a particular recommended product from a certainretailer. The consumer receives the discount and the operator of theinvention receives a commission when the coupon accompanies the sale ofthe recommended product.

Revenue may be realized by directing a consumer to a section that may beincorporated in an embodiment of the invention devoted to new products.Manufacturers or other interested parties pay a fee to the operator ofthe invention in exchange for placing the new product in the specialsection of the invention, for incorporating the new product into theinvention, and the like. Additional fees could be charged for access tothe data generated and/or accumulated by the invention that relates tothe new product.

Yet another revenue stream that may be realized with the inventioncomprises a professional referral fee 1906. Where an embodiment of theinvention capable of detecting serious abnormal conditions that warrantprofessional services does so, professional service providers can pay afee to the operator of the invention to be listed as potential serviceprovider and/or for actually receiving a referral from the invention.

CONCLUSION

While the invention has been described in connection with theembodiments depicted in the various figures, it is to be understood thatother embodiments may be used or modifications and additions may be madeto the described embodiments for performing the same function of theinvention without deviating from the spirit thereof. Therefore, theinvention should not be limited to any single embodiment, whetherexpressly depicted and described herein or not. Rather, the inventionshould be construed to have the full breadth and scope afforded by theclaims appended below.

What is claimed:
 1. A method for improving product recommendationquality, the method comprising: generating a plurality of individualizedproduct recommendations for a given concern with an intelligentperformance-based product recommendation engine; receiving feedback froma plurality of consumers on use of products to treat the concern; andre-training the product recommendation engine based on the feedbackreceived.
 2. The method of claim 1, wherein the receiving feedback stepcomprises receiving product preference data.
 3. The method of claim 1,wherein the receiving feedback step comprises receiving productperformance data.
 4. The method of claim 3, wherein the receivingproduct performance data step further comprises receiving targetsubstrate condition data.
 5. The method of claim 3, wherein thereceiving feedback step further comprises receiving subjective productperformance data.
 6. The method of claim 3, wherein the receivingfeedback step further comprises receiving objective product performancedata.
 7. The method of claim 6, wherein the receiving objective productperformance data step comprises receiving diagnostic data.
 8. The methodof claim 1, wherein the re-training step comprises adjusting values of aplurality of product attributes in a neural network, the neural networkcomprising a portion of the product recommendation engine.
 9. The methodof claim 1, wherein the re-training step comprises adjusting values of aplurality of connection weights in a neural network, the neural networkcomprising a portion of the product recommendation engine.
 10. Themethod of claim 1, wherein the re-training step comprises identifyingrelevant consumer segments based on the feedback and grouping theconsumers into the segments.
 11. The method of claim 1, wherein there-training step comprises revising a set of collaborative neighborhoodconfigurations in a collaborative filter, the collaborative filtercomprising a portion of the product recommendation engine.
 12. Themethod of claim 1, wherein the re-training step comprises adding apersonal profile information filter to a set of collaborativeneighborhood configurations in a collaborative filter, the collaborativefilter comprising a portion of the product recommendation engine.